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1. Scope* 


1.1 This practice covers information for the design and 
operation of a program to monitor and control ongoing stability 
and precision and bias performance of selected analytical 
measurement systems using a collection of generally accepted 
statistical quality control (SQC) procedures and tools. 


Note 1—A complete list of criteria for selecting measurement systems 
to which this practice should be applied and for determining the frequency 
at which it should be applied is beyond the scope of this practice. 
However, some factors to be considered include (/) frequency of use of 
the analytical measurement system, (2) criticality of the parameter being 
measured, (3) system stability and precision performance based on 
historical data, (4) business economics, and (5) regulatory, contractual, or 
test method requirements. 


1.2 This practice is applicable to stable analytical measure- 


ment systems that produce results on a continuous numerical 
scale. 


1.3 This practice is applicable to laboratory test methods. 


1.4 This practice is applicable to validated process stream 
analyzers. 


1.5 This practice is applicable to monitoring the differences 
between two analytical measurement systems that purport to 
measure the same property provided that both systems have 
been assessed in accordance with the statistical methodology in 
Practice D6708 and the appropriate bias applied. 

Note 2—For validation of univariate process stream analyzers, see also 
Practice D3764. 

Note 3—One or both of the analytical systems in 1.5 can be laboratory 
test methods or validated process stream analyzers. 


1.6 This practice assumes that the normal (Gaussian) model 
is adequate for the description and prediction of measurement 
system behavior when it is in a state of statistical control. 


! This practice is under the jurisdiction of ASTM Committee D02 on Petroleum 
Products, Liquid Fuels, and Lubricants and is the direct responsibility of Subcom- 
mittee D02.94 on Coordinating Subcommittee on Quality Assurance and Statistics. 

Current edition approved May 1, 2020. Published May 2020. Originally 
approved in 1998. Last previous edition approved in 2019 as D6299 - 19. DOI: 
10.1520/D6299-20. 


Note 4—For non-Gaussian processes, transformations of test results 
may permit proper application of these tools. Consult a statistician for 
further guidance and information. 


1.7 This international standard was developed in accor- 
dance with internationally recognized principles on standard- 
ization established in the Decision on Principles for the 
Development of International Standards, Guides and Recom- 
mendations issued by the World Trade Organization Technical 
Barriers to Trade (TBT) Committee. 


2. Referenced Documents 


2.1 ASTM Standards:* 

D3764 Practice for Validation of the Performance of Process 
Stream Analyzer Systems 

D4175 Terminology Relating to Petroleum Products, Liquid 
Fuels, and Lubricants 

D5191 Test Method for Vapor Pressure of Petroleum Prod- 
ucts and Liquid Fuels (Mini Method) 

D6300 Practice for Determination of Precision and Bias 
Data for Use in Test Methods for Petroleum Products and 
Lubricants 

D6708 Practice for Statistical Assessment and Improvement 
of Expected Agreement Between Two Test Methods that 
Purport to Measure the Same Property of a Material 

D6792 Practice for Quality Management Systems in Petro- 
leum Products, Liquid Fuels, and Lubricants Testing 
Laboratories 

D7372 Guide for Analysis and Interpretation of Proficiency 
Test Program Results 

E177 Practice for Use of the Terms Precision and Bias in 
ASTM Test Methods 

E178 Practice for Dealing With Outlying Observations 

E456 Terminology Relating to Quality and Statistics 

E691 Practice for Conducting an Interlaboratory Study to 
Determine the Precision of a Test Method 


? For referenced ASTM standards, visit the ASTM website, www.astm.org, or 
contact ASTM Customer Service at service ?astm.org. For Annual Book of ASTM 
Standards volume information, refer to the standard's Document Summary page on 
the ASTM website. i 
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3. Terminology 


3.1 Definitions: 

3.1.1 More extensive lists of terms related to quality and 
statistics are found in Terminology D4175, Practice D6300, 
and Terminology E456. 

3.1.2 repeatability conditions, n—conditions where inde- 
pendent test results are obtained with the same method on 
identical test items in the same laboratory by the same operator 


using the same equipment within short intervals of time. 
D6300 


3.1.3 reproducibility (R), n—a quantitative expression for 
the random error associated with the difference between two 
independent results obtained under reproducibility conditions 
that would be exceeded with an approximate probability of 5 96 
(one case in 20 in the long run) in the normal and correct 
operation of the test method. D6300 


3.1.4 reproducibility conditions, n—conditions where inde- 
pendent test results are obtained with the same method on 
identical test items in different laboratories with different 
operators using different equipment. 


3.1.4.1 Discussion—Different laboratory by necessity 
means a different operator, different equipment, and different 
location and under different supervisory control. D6300 

3.2 Definitions of Terms Specific to This Standard: 

3.2.1 More extensive lists of terms related to quality and 
statistics are found in Terminology D4175, Practice D6300, 
and Terminology E456. 

3.2.2 accepted reference value, n—a value that serves as an 
agreed-upon reference for comparison and that is derived as (7) 
a theoretical or established value, based on scientific principles, 
(2) an assigned value, based on experimental work of some 
national or international organization, such as the U.S. Na- 
tional Institute of Standards and Technology (NIST), or (3) a 
consensus value, based on collaborative experimental work 
under the auspices of a scientific or engineering group. 


3.2.3 accuracy, n—the closeness of agreement between an 
observed value and an accepted reference value. 


3.2.4 analytical measurement system, n—a collection of one 
or more components or subsystems, such as samplers, test 
equipment, instrumentation, display devices, data handlers, 
printouts or output transmitters, that is used to determine a 
quantitative value of a specific property for an unknown 
sample in accordance with a test method. 

3.2.4.1 Discussion—A standard test method (for example, 
ASTM, ISO) may be an example of an analytical measurement 
system. 

3.2.4.2 Discussion—The control chart methodology and 
work processes described in this practice are intended to be 
applied independently to the final results produced from each 
individual measurement system, or, differences between results 
from two individual measurement systems for the same test 
sample. They are not intended to be applied to combined final 
results from multiple individual analytical systems or different 
instruments executing the same test method. 


3.2.5 assignable cause, n—a factor that contributes to varia- 
tion and that is feasible to detect and identify. 


3.2.6 bias, n—a systematic error that contributes to the 
difference between a population mean of the measurements or 
test results and an accepted reference or true value. 


3.2.7 blind submission, n—submission of a check standard 
or quality control (QC) sample for analysis without revealing 
the expected value to the person performing the analysis. 


3.2.8 check standard, n—in QC testing, a material having an 
accepted reference value used to determine the accuracy of a 
measurement system. 

3.2.8.1 Discussion—A check standard is preferably a mate- 
rial that is either a certified reference material with traceability 
to a nationally recognized body or a material that has an 
accepted reference value established through interlaboratory 
testing. For some measurement systems, a pure, single com- 
ponent material having known value or a simple gravimetric or 
volumetric mixture of pure components having calculable 
value may serve as a check standard. Users should be aware 
that for measurement systems that show matrix dependencies, 
accuracy determined from pure compounds or simple mixtures 
may not be representative of that achieved on actual samples. 


3.2.0 common (chance, random) cause, n—for quality as- 
surance programs, one of generally numerous factors, individu- 
ally of relatively small importance, that contributes to 
variation, and that is not feasible to detect and identify. 


3.2.10 control limits, n—limits on a control chart that are 
used as criteria for signaling the need for action or for judging 
whether a set of data does or does not indicate a state of 
statistical control. 


3.2.11 double blind submission, n—submission of a check 
standard or QC sample for analysis without revealing the check 
standard or QC sample status and expected value to the person 
performing the analysis. 


3.2.12 in-statistical-control, adj—a process, analytical mea- 
surement system, or function that exhibits variations that can 
only be attributable to common cause. 


3.2.13 lot, n—a definite quantity of a product or material 
accumulated under conditions that are considered uniform for 
sampling purposes. 


3.2.14 out-of-statistical-control, adj—a process, analytical 
measurement system, or function that exhibits variations in 
addition to those that can be attributable to common cause and 
the magnitude of these additional variations exceed specified 
limits. 


3.2.14.1 Discussion—For clarification, a transition from ап 
in-statistical-control system to an out-of-statistical-control sys- 
tem does not automatically imply that there is a change in the 
fit for use status of the system in terms of meeting the 
requirements for the intended application. 

3.2.15 precision, n—the closeness of agreement between 
test results obtained under prescribed conditions. 


3.2.16 proficiency testing, n—determination of a laborato- 
ry's testing capability by participation in an interlaboratory 
crosscheck program. 

3.2.16.1 Discussion—ASTM Committee D02 conducts pro- 
ficiency testing among hundreds of laboratories, using a wide 
variety of petroleum products and lubricants. 
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3.2.17 quality control (QC) sample, n—for use in quality 
assurance programs to determine and monitor the precision and 
stability of a measurement system, a stable and homogeneous 
material having physical or chemical properties, or both, 
similar to those of typical samples tested by the analytical 
measurement system. The material is properly stored to ensure 
sample integrity, and is available in sufficient quantity for 
repeated, long term testing. 


3.2.18 site expected value (SEV), n—for a QC sample this is 
an estimate of the theoretical limiting value towards which the 
average of results collected from a single in-statistical-control 
measurement system under site precision conditions tends as 
the number of results approaches infinity. 

3.2.18.1 Discussion—The SEV is associated with a single 
measurement system; for control charts that are plotted in 
actual measured units, the SEV 15 required, since it is used as 
a reference value from which upper and lower control limits for 
the control chart specific to a batch of QC material are 
constructed. 


3.2.19 site precision (R'), n—the value below which the 
absolute difference between two individual test results obtained 
under site precision conditions may be expected to occur about 
95 % of the time. It is defined as 2.77 times og. the standard 
deviation of results obtained under site precision conditions. 


3.2.20 site precision conditions, n—conditions under which 
test results are obtained by one or more operators in a single 
site location practicing the same test method on a single 
measurement system which may comprise multiple 
instruments, using test specimens taken at random from the 
same sample of material, over an extended period of time 
spanning at least a 15 day interval. 

3.2.20.1 Discussion—Site precision conditions should in- 
clude all sources of variation that are typically encountered 
during normal, long term operation of the measurement sys- 
tem. Thus, all operators who are involved in the routine use of 
the measurement system should contribute results to the site 
precision determination. In situations of high usage of a test 
method where multiple QC results are obtained within a 24 h 
period, then only results separated by at least 4h to 8 h, 
depending on the absence of auto-correlation in the data, the 
nature of the test method/instrument, site requirements, or 
regulations, should be used in site precision calculations to 
reflect the longer term variation in the system. 


3.2.21 site precision standard deviation, n—the standard 
deviation of results obtained under site precision conditions for 
an individual measurement system and materials that are 
similar in composition and property level to the QC samples 
used to establish the standard deviation. 

3.2.22 validation audit sample, n—a QC sample or check 
standard used to verify precision and bias estimated from 
routine quality assurance testing. 


3.3 Symbols: 
3.3.1 ARV—accepted reference value. 


3.3.2 EWMA—exponentially weighted moving average. 
3.3.3 I|—individual observation (as in /-chart). 


3.3.4 MR—moving range. 


3.3.5 MR—average of moving range. 

3.3.6 QC—quality control. 

3.3.7 R'—site precision. 

3.3.8 SEV—site expected value. 

3.3.9 сре precision standard deviation. 
3.3.10 VA—validation audit. 

3.3.11 y’—chi squared. 

3.3.12 A—lambda. 


4. Summary of Practice 


4.1 QC samples and check standards are regularly analyzed 
by the measurement system. Control charts and other statistical 
techniques are presented to screen, plot, and interpret test 
results in accordance with industry-accepted practices to as- 
certain the in-statistical-control status of the measurement 
system. 


4.2 Statistical estimates of the measurement system preci- 
sion and bias are calculated and periodically updated using 
accrued data. 


4.3 In addition, as part of a separate validation audit 
procedure, QC samples and check standards may be submitted 
blind or double-blind and randomly to the measurement system 
for routine testing to verify that the calculated precision and 
bias are representative of routine measurement system perfor- 
mance when there is no prior knowledge of the expected value 
or sample status. 


5. Significance and Use 


5.1 This practice can be used to continuously demonstrate 
the proficiency of analytical measurement systems that are 
used for establishing and ensuring the quality of petroleum and 
petroleum products. 


5.2 Data accrued, using the techniques included in this 
practice, provide the ability to monitor analytical measurement 
system precision and bias. 


5.3 These data are useful for updating test methods as well 
as for indicating areas of potential measurement system im- 
provement. 


6. Reference Materials 


6.1 QC samples are used to establish and monitor the 
precision of the analytical measurement system. 

6.1.1 Select a stable and homogeneous material having 
physical or chemical properties, or both, similar to those of 
typical samples tested by the analytical measurement system. 


Note 5—When the QC sample is to be utilized for monitoring a process 
stream analyzer performance, it is often helpful to supplement the process 
analyzer system with a subsystem to automate the extraction, mixing, 
storage, and delivery functions associated with the QC sample. 

6.1.2 Estimate the quantity of the material needed for each 
specific lot of QC sample to (7) accommodate the number of 
analytical measurement systems for which it is to be used 
(laboratory test apparatuses as well as process stream analyzer 
systems) and (2) provide determination of QC statistics for a 
useful and desirable period of time. 
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6.1.3 Collect the material into a single container and isolate 
it. 

6.1.4 Thoroughly mix the material to ensure homogeneity. 

6.1.5 Conduct any testing necessary to ensure that the QC 
sample meets the characteristics for its intended use. 

6.1.6 Package or store QC samples, or both, as appropriate 
for the specific analytical measurement system to ensure that 
all analyses of samples from a given lot are performed on 
essentially identical material. If necessary, split the bulk 
material collected in 6.1.3 into separate and smaller containers 
to help ensure integrity over time. (Warning—Treat the 
material appropriately to ensure its stability, integrity, and 
homogeneity over the time period for which it is to stored and 
used. For samples that are volatile, such as gasoline, storage in 
one large container that is repeatedly opened and closed can 
result in loss of light ends. This problem can be avoided by 
chilling and splitting the bulk sample into smaller containers, 
each with a quantity sufficient to conduct the analysis. 
Similarly, samples prone to oxidation can benefit from splitting 
the bulk sample into smaller containers that can be blanketed 
with an inert gas prior to being sealed and leaving them sealed 
until the sample is needed.) 


6.2 Check standards are used to estimate the accuracy of the 
analytical measurement system. 

6.2.1 A check standard may be a commercial standard 
reference material when such material is available in appropri- 
ate quantity, quality and composition. 


Note 6—Commercial reference material of appropriate composition 
may not be available for all measurement systems. 


6.2.2 Alternatively, a check standard may be prepared from 
a material that is analyzed under reproducibility conditions by 
multiple measurement systems. The accepted reference value 
(ARV) for this check standard shall be the average after 
statistical examination and outlier treatment has been applied.? 

6.2.2.1 Exchange samples circulated as part of an interlabo- 
ratory exchange program, or round robin, may be used as check 
standards. For an exchange sample to be usable as a check 
standard, the standard deviation of the interlaboratory ex- 
change program shall not be statistically greater than the 
reproducibility standard deviation for the test method. An 
F-test should be applied to test acceptability. 


Note 7—The uncertainty in the ARV is inversely proportional to the 
square root of the number of values in the average. This practice 
recommends that a minimum of 16 non-outlier results be used in 
calculating the ARV to reduce the uncertainty of the ARV by a factor of 
4 relative to the measurement system single value precision. The bias tests 
described in this practice assume that the uncertainty in the ARV is 
negligible relative to the measurement system precision. If less than 16 
values are used in calculating the average, this assumption may not be 
valid. 

Note 8—Examples of exchanges that may be acceptable are ASTM 
D02.CS92 ILCP program; ASTM D02.01 N.E.G.; ASTM D02.01.A 
Regional Exchanges; International Quality Assurance Exchange Program, 
administered by Alberta Research Council. 


3 Бог guidance in statistical and outlier treatment of data, refer to Research 
Report RR:D02-1007, Practices E178 and E691, and ASTM Standards on Precision 
and Bias for Various Applications, ASTM International, 1997. 


6.2.3 For some measurement systems, single, pure compo- 
nent materials with known value, or simple gravimetric or 
volumetric mixtures of pure components having calculable 
value may serve as a check standard. For example, pure 
solvents, such as 2,2-dimethylbutane, are used as check stan- 
dards for the measurement of Reid vapor pressure by Test 
Method D5191. Users should be aware that for measurement 
systems that show matrix dependencies, accuracy determined 
from pure compounds or simple mixtures may not be repre- 
sentative of that achieved on actual samples. 


6.3 Validation audit (VA) samples are QC samples and 
check standards, which may, at the option of the users, be 
submitted to the measurement system in a blind, or double 
blind, and random fashion to verify precision and bias esti- 
mated from routine quality assurance testing. 


7. Quality Assurance (QA) Program for Individual 
Measurement Systems 


7.1 Overview—A QA program (1)* can consist of five 
primary activities: (7) monitoring stability and precision 
through QC sample testing, (2) monitoring accuracy, (3) 
periodic evaluation of system performance in terms of preci- 
sion or bias, or both, (4) proficiency testing through participa- 
tion in interlaboratory exchange programs where such pro- 
grams are available, and (5) a periodic and independent system 
validation using VA samples may be conducted to provide 
additional assurance of the system precision and bias metrics 
established from the primary testing activities. At minimum, 
the QA program must include at least item one and item two, 
subject to check standard availability (see 7.1.1). 

7.1.1 For some measurement systems, suitable check stan- 
dard materials may not exist, and there may be no reasonably 
available exchange programs to generate them. For such 
systems, there is no means of verifying the accuracy of the 
system, and the QA program will only involve monitoring 
stability and precision through QC sample testing. 


Note 9—For guidance on the establishment and maintenance of the 
essentials of a quality system, see Practice D6792. 

Note 10—For guidance on the analysis and interpretation of profi- 
ciency test (PT) program results, see Guide D7372. 

7.2 Monitoring System Stability and Precision Through QC 
Sample Testing—QC test specimen samples from a specific lot 
are introduced and tested in the analytical measurement system 
on a regular basis to establish system performance history in 
terms of both stability and precision. 


7.3 Monitoring Accuracy: 

7.3.] Check standards can be tested in the analytical mea- 
surement system on a regular basis to establish system perfor- 
mance history in terms of accuracy. 


7.4 Test Program Conditions/Frequency: 
7.4.1 Conduct both QC sample and check standard testing 
under site precision conditions. 


Note 11—1 is inappropriate to use test data collected under repeat- 
ability conditions to estimate the long term precision achievable by the site 


+ The boldface numbers in parentheses refer to the list of references at the end of 
this standard. 
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because the majority of the long term measurement system variance is due 
to common cause variations associated with the combination of time, 
operator, reagents, instrumentation calibration factors, and so forth, which 
would not be observable in data obtained under repeatability conditions. 

7.4.2 Test the QC and check standard samples on a regular 
schedule, as appropriate. Principal factors to be considered for 
determining the frequency of testing are (1) frequency of use of 
the analytical measurement system, (2) criticality of the pa- 
rameter being measured, (3) established system stability and 
precision performance based on historical data, (4) business 
economics, and (5) regulatory, contractual, or test method 
requirements. 


Note 12—At the discretion of the laboratory, check standards may be 
used as QC samples. In this case, the results for the check standards may 
be used to monitor both stability (see 7.2) and accuracy (see 7.3) 
simultaneously. ЈЕ check standards are expensive, or not available in 
sufficient quantity, then separate QC samples are employed. In this case, 
the accuracy (see 7.3) is monitored less frequently, and the QC sample 
testing (see 7.2) is used to demonstrate the stability of the measurement 
system between accuracy tests. 

7.4.3 It is recommended that a QC sample be analyzed at the 
beginning of any set of measurements and immediately after a 
change is made to the measurement system. 

7.4.4 Establish a protocol for testing so that all persons who 
routinely operate the system participate in generating QC test 
data. 

7.4.5 Handle and test the QC and check standard samples in 
the same manner and under the same conditions as samples or 
materials routinely analyzed by the analytical measurement 
system. 

7.4.6 When practical, randomize the time of check standard 
and additional QC sample testing over the normal hours of 
measurement system operation, unless otherwise prescribed in 
the specific test method. 


Note 13—Avoid special treatment of QC samples designed to get a 
better result. Special treatment seriously undermines the integrity of 
precision estimates. 

7.5 Evaluation of System Performance in Terms of Precision 
and Bias: 

7.5.1 Pretreat and screen results accumulated from QC and 
check standard testing. Apply statistical techniques to the 
pretreated data to identify erroneous data. Plot appropriately 
pretreated data on control charts. 

7.5.2. Periodically analyze results from control charts, ex- 
cluding those data points with assignable causes, to quantify 
the bias and precision estimates for the measurement system. 


7.6 Proficiency Testing: 

7.6.1 Participation in regularly conducted interlaboratory 
exchanges where typical production samples are tested by 
multiple measurement systems, using a specified (ASTM) test 
protocol, provide a cost-effective means of assessing measure- 
ment system accuracy relative to average industry perfor- 
mance. Such proficiency testing can be used instead of check 
standard testing for systems where the timeliness of the 
accuracy check is not critical. Proficiency testing may be used 
as a supplement to accuracy monitoring by way of check 
standard testing. 

7.6.2 Participants plot their signed deviations from the 
consensus values (exchange averages) on control charts in the 


same fashion described below for check standards, to ascertain 
if their measurement processes are non-biased relative to 
industry average. 


7.7 Independent System Validation—Periodically, at the dis- 
cretion of users, УА samples may be submitted blind or double 
blind for analysis. Precision and bias estimates calculated using 
МА samples test data can be used as an independent validation 
of the routine QA program performance statistics. 


Note 14—For measurement systems susceptible to human influence, 
the precision and bias estimates calculated from data where the analyst is 
aware of the sample status (QC or check standard) or expected values, or 
both, may underestimate the precision and bias achievable under routine 
operation. At the discretion of the users, and depending on the criticality 
of these measurement systems, the QA program may include periodic 
blind or double-blind testing of VA samples. 


7.7.1 The specific design and approach to the VA testing 
program will depend on features specific to the measurement 
system and organizational requirements, and is beyond the 
intended scope of this practice. Some possible approaches are 
noted as follows. 

7.7.1.1 If all QC samples or check standards, or both, are 
submitted blind or double blind and the results are promptly 
evaluated, then additional VA sample testing may not be 
necessary. 

7.7.1.2 QC samples or check standards, or both, may be 
submitted as unknown samples at a specific frequency. Such 
submissions should not be so regular as to compromise their 
blind status. 

7.7.1.3 Retains of previously analyzed samples may be 
resubmitted as unknown samples under site precision condi- 
tions. Generally, data from this approach can only yield 
precision estimates as retain samples do not have ARVs. 
Typically, the differences between the replicate analyses are 
plotted on control charts to estimate the precision of the 
measurement system. If precision is level dependent, the 
differences are scaled by the standard deviation of the mea- 
surement system precision at the level of the average of the two 
results. 


8. Procedure for Pretreatment, Assessment, and 
Interpretation of Test Results 


8.1 Overview—Results accumulated from QC, check 
standard, and VA sample testing are pretreated and screened. 
Statistical techniques are applied to the pretreated data to 
achieve the following objectives: 

8.1.1 Identify erroneous data (outliers). 

8.1.2 Assess initial results to validate system stability and 
assumptions associated with use of control chart technique (for 
example, dataset normality, adequacy of variations in the 
dataset relative to measurement resolution). 

8.1.3 Deploy, interpret, and maintain control charts. 


8.1.4 Quantify long term measurement precision and bias. 


Note 15—Refer to the annex for examples of the application of the 
techniques that are discussed below and described in Section 9. 


8.2 Pretreatment of Test Results—The purpose of pretreat- 
ment is to standardize the control chart scales so as to allow for 
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data from multiple check standards or different batches of QC 
materials with different property levels to be plotted on the 
same chart. 

8.2.1 For QC sample test results, no data pretreatment is 
necessary if results for different QC samples are plotted in 
actual measurement units on different control charts. 

8.2.2 For check standard sample test results that are to be 
plotted on the same control chart, two cases apply, depending 
on the measurement system precision: 

8.2.2.1 Case 1—If either (7) all of the check standard test 
results are from one or more lots of check standard material 
having the same АКУ (5), or (2) the precision of the measure- 
ment system is constant across levels, then pretreatment 
consists of calculating the difference between the test result and 
the ARV: 


Pretreated result — test result — ARV(for the sample) (1) 


8.2.2.2 Case 2—Test results are for multiple lots of check 
standards with different ARVs, and the precision of the 
measurement system is known to vary with level, 


Pretreated result= (2) 
[test result — check standard ARV /sqrt | (standard error of ARV)? + 


(std dev of site test method at the ARV level)?] 
where the standard error of the ARV 15 the uncertainty asso- 
ciated with the ARV as supplied by the check standard sup- 
plier; the standard deviation of site test method at the ARV 
level is the established standard deviation of the site's test 
method under site precision conditions at nominally the ARV 
level. In the event the ARV was established through round 
robin testing, standard deviations determined from outlier- 
free and normally distributed round robin test results may be 
used to calculate the standard error of the ARV in accor- 


dance with statistical theory. (See Note 16.) 


8.2.2.3 If the ARV was not arrived at by round robin testing, 
a standard error of the ARV should be determined by users in 
a technically acceptable manner. 


Note 16—It is recommended that the method used to determine the 
standard error of the ARV be developed under the guidance of a 
statistician. 

8.2.3 Pretreatment of results for VA samples is done in the 
same manner as described in 8.2.1 and 8.2.2. 


8.3 Control Charts (1, 2)—Individual (Г), moving range of 
two (MR) control charts, and either Strategy 1 (additional run 
rules) (3) or Strategy 2 (EWMA) (4, 5, 6) are the recommended 
toolset (see Annex A1) for (a) routine recording of QC sample 
and check standard test results, and (b) immediate assessment 
of the “in statistical control" (7) status of the system that 
generated the data. The / chart is intended to detect occurrence 
of a sudden, unique event that causes a large deviation from the 
expected value for the QC material. Strategy 1 (additional Run 
Rules) or Strategy 2 (EWMA) is intended to detect small levels 
of sustained shifts or drifts of the complete analytical system. 
MR chart is intended to detect changes in the analytical system 
overall variability. 


Note 17— The control charts and statistical techniques described in this 
practice are chosen for their simplicity and ease of use. It is not the intent 
of this practice to preclude use of other statistically equivalent or more 


advanced techniques, or both. 


8.3.1 Control charting can be viewed as a two-staged work 
process where: 

Stage 1 comprises assessment of initial test results (for a 
QC material) and construction of the control chart with 
graphically represented assessed results and statistical values 
that describes the location of where future test results for this 
QC material from the measurement systems are expected to fall 
within, on the assumption that the measurement system and 
QC material remains unchanged. 

Stage 2 comprises regular assessment of future test results 
(for the QC material) as they arrive in chronological order 
against the established expectations in Stage 1; as well as a 
periodic reevaluation of the expectation statistics of all accrued 
results to update the expectations statistics established from 
Stage 1, if necessary. 


STAGE 1—Assessment and Chart Construction 


8.4 Assessment of Initial Results—Assessment techniques 
are applied to test results collected during the initial startup 
phase of or after significant modifications to a measurement 
system (see Note 19). Perform the following assessment after 
at least 20 pretreated results have become available. The 
purpose of this assessment is to ensure that these results are 
suitable for deployment of control charts (described in A 1.4). 


Note 18—These techniques can also be applied as diagnostic tools to 
investigate out-of-control situations. 

Norte 19—During the data collection phase in Stage 1, users can deploy 
the procedures described in 8.7.2.3 or 8.7.3 (Q-procedure) or 8.7.4 to 
monitor measurement process performance. 


8.4.1 Screen for Suspicious Results—Pretreated results 
should first be visually screened for values that are inconsistent 
with the remainder of the data set, such as those that could have 
been caused by transcription errors. Those flagged as suspi- 
cious should be investigated. Discarding data at this stage must 
be supported by evidence gathered from the investigation. If, 
after discarding suspicious pretreated results there are less than 
15 values remaining, collect additional data and start over. 

8.4.2 Screen for Unusual Patterns—The next step is to 
examine the pretreated results for non-random patterns such as 
continuous trending in either direction, unusual clustering, and 
cycles. One way to do this is to plot the results on a run chart 
(see A1.3) and examine the plot. If any non-random pattern is 
detected, investigate for and eliminate the root cause(s). 
Discard the data set and start the procedure again. 

8.4.3 Test "Normality" Assumption, Independence of Test 
Results, and Adequacy of Measurement Resolution—For mea- 
surement systems with no prior performance history, or as а 
diagnostic tool, it is useful to test that the results from the 
measurement system are reasonably independent, with ad- 
equate measurement resolution, and can be adequately mod- 
elled by a normal distribution. One way to do this is to use a 
normal probability plot and the Anderson-Darling Statistic (see 
A 1.4). If the results show obvious deviation from normality or 
obvious measurement resolution inadequacy (see А 1.4), follow 
the guidance in A1.4.2.6, Case 2. 


Note 20—Transformations may lead to normally distributed data, but 
these techniques are outside the scope of this practice. 
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8.4.4 Construction of Control Charts—If no obvious un- 
usual patterns are detected from the run charts, and no obvious 
deviation from normality is detected, proceed with construc- 
tion of the control charts 

8.4.4.1 Construct an MR plot and examine it for unusual 
patterns. If no unusual patterns are found in the MR plot, 
calculate and overlay the control limits on the MR plot to 
complete the MR chart. 

8.4.4.2 I Chart—Calculate control limits and overlay them 
on the “тип chart" to produce the 7 chart. 

8.4.4.5 EWMA Overlay—Optionally, calculate the EWMA 
values and plot them on the 7 chart. Calculate the EWMA 
control limits and overlay them on the / chart. 


STAGE 2—Deployment for Monitoring and Periodic Re- 
assessment 
8.4.5 Control Chart Deployment—Put these control charts 
into operation by regularly plotting the pretreated test results 
on the charts and immediately interpreting the charts. 


8.5 Control Chart Interpretation: 

8.5.1 Apply control chart rules (see A1.5) to determine if 
the data supports the hypothesis that the measurement system 
is under the influence of common causes variation only (in 
statistical control). 

8.5.2 Investigate Out-of-Control Points in Detail —Exclude 
from further data analysis those associated with assignable 
causes, provided the assignable causes are deemed not to be 
part of the normal process. 


Note 21—АП data, regardless of in-control or out-of-control status, 
needs to be recorded. 


8.6 Scenario 1 for Periodic Updating of Control Charts 
Parameters: 

8.6.1 Scenario 1 covers (/) control charts for a QC material 
where there had been no change in the system, but more data 
of the same level has been accrued; or (2) control charts for 
check standard pretreated results. 

8.6.2 When a minimum of 20 new in-control data points 
becomes available, perform an F-test (see А1.8) of sample 
variances for the new data set versus the sample variance used 
to calculate the current control chart limits. If the outcome of 
the F-test is not significant, and, if the sample variance used to 
calculate the current control limits is based on less than 100 
data points, statistically pool both sample variances and then 
update the current control limits based on this new pooled 
variance. 

8.6.3 If the outcome of the F-test is not significant, and if 
the sample variance used to calculate the current control limits 
is based on more than 100 data points, the statistical pooling of 
both sample variances and update of the current control limits 
can be at the discretion of the user. 

8.6.4 If the outcome of the F-test is significant, investigate 
for assignable causes. Update the current control limits based 
on this new sample variance if it is determined that this new 
variance is representative of current system performance. 


8.7 Scenario 2 for Periodic Updating of Control Charts 
Parameters: 


8.7.1 Scenario 2 covers control chart for QC materials 
where an assignable cause change in the system had occurred 
due to a change of QC material as the current QC material 
supply is exhausted. Minor or major differences in measured 
property level may exist between QC material batches. Since 
control limit calculations for the / chart require a center value 
established by the measurement system, a special transition 
procedure is required to ensure that the center value for a new 
batch of QC material is established using results produced by 
a measurement system that is in statistical control. This 
practice presents two procedures to be selected at the users' 
discretion. 

8.7.2 Procedure 1, Concurrent Testing: 

8.7.2.1 Collect and prepare a new batch of QC material 
when the current QC material supply remaining can support no 
more than 20 analyses. 

8.7.2.2 Concurrently test and record data for the new 
material each time a current QC sample is tested. The result for 
the new material is deemed valid if the measurement process 
in-control status is validated by the current QC material and 
control chart. 

8.7.2.3 Optionally, to provide an early indication of the 
status of the new batch of QC material, immediately start a run 
chart and an MR plot for the new material. After five valid 
results become available for the new material, convert the run 
chart into an / chart with trial control limits by adding a center 
line based on the average of the five results and control limits 
based on the MR from previous control charts for materials at 
the same nominal level. Set trial control limits for the MR chart 
based on limits from previous charts for materials at the same 
nominal level. 


8.7.2.4 After a minimum of 20 in-control data points are 
collected on the new material, perform an F-test of sample 
variances for the new data set versus the historical variance 
demonstrated at nominal level of the new material. If the 
outcome of the F-test is not significant, and, if the historical 
variance demonstrated at nominal level of the new material is 
based on less than 100 data points, statistically pool both 
sample variances and then update the current control limits 
based on this new pooled variance. 

8.7.2.5 If the outcome of the F-test is not significant, and, if 
the historical variance demonstrated at nominal level of the 
new material is based on more than 100 data points, the 
statistical pooling of both sample variances and update of the 
current control limits can be at the discretion of the user. 

8.7.2.6 If the outcome of the F-test is significant, investigate 
for assignable causes. Update the current control limits based 
on this new sample variance if it is determined that this new 
variance is representative of current system performance. 

8.7.2.7 Construct new J and MR charts (and EWMA overlay 
for strategy 2) for this new material as per Section 8, using the 
pooled MR. 


8.7.2.8 Switch over to the new 7 and MR charts upon 
depletion of current QC material. 

8.7.3 Procedure 2-A, Q-Procedure (see А1.9): 

8.7.3.1 This procedure is designed to alleviate the need for 
concurrent testing of two materials. A priori knowledge of the 
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measurement process historical standard deviation (Oknown) 
applicable at the new QC material composition and property 
level is required. A Q, statistic is computed with the arrival of 
each new QC result commensurate with the 2nd result, and 
compared against its theoretical mean (0) and 3 sigma limits 
(= 3). See А1.9 for details. 


Note 22—It is recommended that this standard deviation estimate be 
based on at least 50 data points. 


8.7.3.2 When the Q-procedure is operational (minimum of 
two data points), it can be used in conjunction with a MR chart 
constructed using the observations to provide QA of the 
measurement process. 

8.7.3.3 Because the Q-procedure is technically equivalent to 
the I chart procedure, after 20 data points have been accrued 
(by the Q-procedure), the user can either follow the steps 
described in 8.7.2 on Concurrent Testing after 20 data points 
have been accrued to construct a new УМК control chart for the 
new batch of QC material, or continue to operate the Q-chart 
and MR chart for measurement process stability and precision 
monitoring, respectively, using the new batch of QC material. 

8.7.3.4 It is necessary to start a new Q-chart with each new 
batch of QC material. 

8.7.3.5 A common Q-chart and MR chart can be used for 
pre-treated results as per Case 1 and Case 2 in 8.2. For Case 1, 
the standard deviation shall be the applicable standard devia- 
tion for the check standard material; for Case 2, the standard 
deviation is 1 since Eq 2 is a standardized normal deviate. 

8.7.4 Procedure 2-B: Dynamically Updated I / EWMA 
Chart—This is essentially an I-chart and EWMA with varying 
control chart limits that are updated with the arrival of each 
new result, which is judged using limits computed from all 
previous results. The dynamic update combines ће брома for 
the individual result with the varying standard error associated 
with the center line computed with all previous results. This 
standard error (for the I-chart) steadily decreases as the number 
of results used for its computation increases, whilst for the 
EWMA, the standard error typically decrease initially and then 
increases towards its asymptotic value. See A 1.10 for details. 


Note 23—Procedure 2-В was formerly referred to as Q-chart Option 1. 


8.8 Short Run Scenario—The Q-procedure (described in 
8.7.3) can also be used to address short run situations where a 
single batch of QC material can provide only a limited number 
(less than 20) of QC test results and replacement of exactly the 
same material is not feasible or possible. For these short run 
QC batches, since there is insufficient data to properly charac- 
terize the mean of batch, the Q-procedure, in conjunction with 
the MR chart, can be used to monitor stability and precision of 
the measurement process, respectively. 


8.9 Instrument Replacement or Post Overhaul Scenario— 
The procedures described in 8.7.3 and 8.7.4 may be used to 
address situations where an instrument is taken out of service 
and is replaced by another qualified instrument, or, when the 
primary instrument is returned to service after a major overhaul 
such as replacement of critical parts or factory re-calibration. 
For these situations, the existing system precision parameters 
can be used, in conjunction with the MR chart, to monitor 
stability and precision of the replacement or overhauled 


measurement process, respectively, based on the assumption 
that the existing system precision parameter is still valid. After 
sufficient data is accrued, a statistical assessment shall be 
performed to confirm this assumption, or update the system 
precision parameters accordingly. Use of the existing precision 
will enable the system to be immediately put into service, 
while providing a safeguard against the situation where the 
new system performance with replacement or overhauled 
instrument is statistically worse than the previous system 
performance. Use of the Q-procedure is in addition to any steps 
such as calibration and running check standards needed to 
qualify replacement instruments. 


9. Evaluation of System Performance in Terms of 
Precision and Bias 


9.1 Site Precision Estimated from Testing of QC Samples: 

9.1.1 Estimate the site precision of the measurement system 
at the level corresponding to a specific lot of QC sample using 
the root-mean-square (rms) formula for standard deviation 
(бр). 


(3) 
R' = 277 хор. (4) 


9.1.1.1 Alternatively, in the absence of auto-correlation in 
the data (see A1.4), R' may be estimated as 2.46 times the 
average of the moving range (мк) from the MR chart for that 
specific lot. 


R' = 2.46 X MR (5) 
Note 24—The site precision standard deviation (ов-) is estimated from 
the MR chart as R'/2.77=(MR)/1.128. 


9.1.1.2 For estimate of site precision standard deviation 
(бр) using retain results, first obtain the standard deviation of 
differences by applying the root-mean-square formula below to 
the differences between the original and retest results for 
samples with same nominal property level. If measurement 
process precision is known to be level independent, retest 
results from samples with different property levels can be used. 
Otherwise, sample pairs with nominally similar property level 
(general rule is within 2R) should be used to estimate the site 
precision at the nominal property level. Divide the standard 
deviation of differences by 1.414 to obtain the estimate for site 
precision standard deviation. (Op). 


standard deviation of differences= (6) 


У, (individual difference — average difference)? 
total number of differences 


c, = (standard deviation of differences)+ 1.414 (7) 


9.1.2 Compare К' to published reproducibility of the test 
method at the same level, if available. R' is expected to be less 
than or equal to the published value. Use the у” test described 
in AI.7. 


9.2 Measurement System Bias Estimated from Multiple 
Measurements of a Single Check Standard—If a minimum of 
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15 test results is obtained on a single check standard material 
under site precision conditions, then calculate the average of all 
the in-control individual differences plotted on the / chart. 
Perform a t-test (see A1.6) to determine if the average is 
statistically different from zero. 

9.2.1 If the outcome of the t-test is that the average is not 
statistically different from zero, then the bias in the measure- 
ment process is negligible. 

9.2.2 If the outcome of the t-test is that the average is 
statistically different from zero, then the best estimate of the 
measurement process bias at the level of the check standard is 
the average. If bias is deemed to be of practical significance by 
the user, investigate for root causes, and take corrective 
measures. 


9.3 Measurement System Bias Estimated from Measure- 
ments of Multiple Check Standards—When using multiple 
check standards, determine if there is a relationship between 
the bias and the measurement level. 

9.3.1 Plot the pretreated results as per Section 8 versus their 
corresponding ARVs. Examine the plot for patterns indicative 
of level-dependent bias. 

9.3.2 If there is no discernible pattern, perform the t-test as 
described in 9.2 to determine if the average of all the pretreated 
differences plotted on the / chart is statistically different from 
Zero. 

9.3.2.1 If the outcome of the t-test is that the average is not 
statistically different from zero, then the bias in the measure- 
ment process is negligible. 

9.3.2.2 If the outcome of the t-test is that the average is 
statistically different from zero, then there is evidence that the 
measurement system is biased. The bias may be level depen- 
dent. However, the statistical methodology for estimating the 
bias/level relationship is beyond the scope of this practice. 

9.3.3 If there is a discernible pattern in the plot in 9.3.1, then 
the measurement system may exhibit a level dependent bias. 
The statistical methodology for estimating the bias/level rela- 
tionship is beyond the scope of this practice. 

9.3.4 If a bias is detected in 9.3.2.2, or if the plot in 9.3.3 
exhibits discernible patterns, investigate for root cause(s). 


9.3.4.] If there is evidence of a bias versus level 
relationship, or, if users wish to perform a more rigorous 
examination of the bias versus level relationship with multiple 
check standards, it is recommended that the principles of 
Practice D6708 be employed under the guidance of qualified 
statistical expertise. 


10. Validation of System Performance Estimates Using 
VA Samples 


10.1 If the users decide to include VA sample testing as part 
of their QA program, then they should periodically evaluate the 
results obtained on the VA samples. The purpose of the 
evaluation is to establish whether the system performance 
estimates described in Section 9 are reasonably applicable to 
routinely tested samples. 


10.2 VA sample test results should be evaluated indepen- 
dently through an internal or external audit system, or both. It 
is recommended that the internal audit team not be limited to 
the operators of the measurement system and their immediate 
supervisors. 


10.3 Insofar as possible, analyze the results obtained on the 
VA samples separately and in the same manner as those from 
the routine QC and check standard testing program. 


10.4 Using F- or t- tests, or both (see А1.8 and А1.6), 
statistically compare the system performance estimates ob- 
tained from the VA sample testing program to the measurement 
system accuracy and precision estimates from the QC sample 
testing program. 


10.5 If the comparison reveals that the two estimates of the 
measurement system performance are not statistically 
equivalent, there is cause for concern that the actual perfor- 
mance of the measurement system may be significantly worse 
than estimated. Investigate thoroughly for the assignable 
cause(s) of this inconsistency, and eliminate it. Until the causes 
are identified and eliminated, the lab precision estimates of 
Section 9 should be considered suspect. 


ANNEX 


(Mandatory Information) 


A1. STATISTICAL QUALITY CONTROL TOOLS 


А1.1 Purpose of this Annex 


А1.1.1 The purpose of this annex is to provide guidance to 
practitioners, including worked examples, for the proper ex- 
ecution of the statistical procedures described in this practice. 
See Tables A1.1-A1.14 and Figs. А1.1–А1.16. 


Note Al.1—For some examples in this annex, 15 data points are used 
to illustrate calculation and plotting methodologies; it is not the intention 
of this annex to override the mandatory requirement of 20 minimum data 
points (see 8.4). Work is underway to revise the annex examples to use 20 
data points for all examples. 


A1.2 Pretreatment of Test Results (8.1 to 8.2.3) 


А1.2.1 Throughout this annex, [Y;i-l. . .n} denotes а 
sequence of as measured test results. {J,:i=1. . .n} will signify 
a sequence of test results after pretreatment, if necessary. 


A1.2.2 If {Y,:i=1...n} is a sequence of results from a single 
QC sample, then 


(Al.1) 


with no pretreatment being required. 


- 20 


А1.2.2.1 An example of a sequence of results, У, from a 
single QC sample is given in Columns 2 and 4 of Table A1.3. 


А1.2.3 If {Y,:i=1. ..n) is a sequence of results from a single 
check standard, from multiple check standards having nomi- 
nally the same ARV, or from multiple check standards having 
different ARVs where the precision of the measurement system 
does not vary with level, and if { X;,-i=1. . л) is the sequence 
of corresponding ARVs, then 


1, 2 Y, - X, (А1.2) 


The site precision (К?) of the measurement process must be 
essentially the same for all values {X;}. 

A1.2.3.1 An example of a sequence of results from a single 
check standard is given in Table A 1.4. The preprocessed result, 
I; 15 given in Column 4 of Table A 1.4. 


А1.2.4 If (Y;) is a sequence of results from different check 
standards, and if the reproducibility varies with the level of the 
accepted reference values, {X;}, then 


I, = (Y, — X,)/o, (А1.3) 


where o; are estimates of the standard deviation under site 
precision conditions of the measurement process at levels (Х,). 

А1.2.4.1 Table A1.5 shows an example of results for mul- 
tiple check standards where the precision of the measurement 
system is level dependent. 

А1.2.4.2 Discussion—Site precision (R°) estimates at ARV 
values that are significantly different from those in the site's 
historical database can also be estimated proportionally using 
the published R at the ARV level. Calculate the fraction of К” 
and R at the ARV level with known R' and multiply this 
fraction by R at the new ARV level with unknown R' to arrive 
at the estimated R’ at the new ARV level. This approach is 
based on the assumption that the fraction of R' and R is 
constant among different ARV levels. Users are cautioned that 
this assumption may not be valid if the published precision has 
different functional forms between r and R. Note that this 
fraction is the inverse of TPI (Test Performance Index) as 
defined in Practice D6792. 

Example: 

R' of site (calculated from actual QC data) at sulfur level 10 
ppm = 2 ppm (published К at sulfur level of 10 ppm = 3 ppm). 

Fraction of R’/R at 10 ppm = 2/3 

Estimated R’ of site at sulfur level at 15 ppm is estimated as: 
(2/3)* (published R at sulfur level of 15 ppm). 


А1.3 The Run Chart 


A1.3.1 Arun chart is a plot of results in chronological order 
that can be used to screen data for unusual patterns. Preferably, 
pretreated results are plotted. Use a run chart to screen data for 
unusual patterns such as continuous trending in either 
direction, unusual clustering, and cycles. Several non-random 
patterns are described in control chart literature. When control 
parameters have been added to a run chart, it becomes a control 
chart of individual values (1 chart). 


А1.3.2 Plot results on the chart. Plot the first result at the 
left, and plot each subsequent point one increment to the right 
of its predecessor. The points may be connected in sequence to 
facilitate interpretation of the run chart. 
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A1.3.3 Allow sufficient space in the x-axis direction to 
accommodate as many results as should be obtained from a 
consistent batch of material. Allow enough space in the y-axis 
direction to accommodate the expected minimum and maxi- 
mum of the data. 


A1.3.4 Example of a Run Chart for QC Results—The first 
15 results from Column 2 of Table A 1.3 are plotted in sequence 
as they are collected as shown in Fig. A1.1. The data would be 
examined for unusual patterns. 


A1.3.5 Example of a Run Chart for Multiple Results from a 
Single Check Standard—The first 15 preprocessed results 
(differences) from Column 4 of Table А1.4 are plotted in 
sequence as they are collected as shown in Fig. A1.2. The data 
would be examined for unusual patterns. 


A1.3.6 Example of a Run Chart for Results from Multiple 
Check Standards—The first 15 preprocessed results (differ- 
ences scaled by о,) from Table А1.5 are plotted in sequence as 
they are collected as shown in Fig. A1.3. The data would be 
examined for unusual patterns. 


А1.4 Normality, Data Independence, and Resolution Ad- 
equacy Checks 


А1.4.1 A normal probability plot (a special case of a q-q 
plot) is used to visually assess the validity of the assumption 
that the observations are normally distributed. Since the control 
chart and limits prescribed in this practice are based on the 
assumption that the data behavior is adequately modeled by the 
normal distribution, it is recommended that a test of this 
normality assumption be conducted. 

А1.4.1.1 To construct a normal probability plot: 

(1) Create a column of the observations sorted in ascending 
order. 

(2) Select the appropriate column from Fig. A1.4, based on 
the number of observations (л). 

(3) Plot each observation in the sorted column (y-value) 
against its corresponding value from Fig. A1.4 (z-value). 

А1.4.1.2. Visually inspect the plot for an approximately 
linear relationship. If the results are normally distributed, the 
plot should be approximately linear. Major deviations from 
linearity are an indication of nonnormal distributions of the 
differences. 


Моте А1.2—Тће assessment methodology of the normal probability 
plot advocated in this practice is strictly visual due to its simplicity. For 
statistically more rigorous assessment techniques, users are advised to use 
the Anderson-Darling technique described below, and consult a statisti- 
cian. 

А1.4.2 Anderson-Darling Statistic—The Anderson-Darling 
(A-D) statistic is used to objectively test for normality, data 
independence, and adequacy of measurement resolution rela- 
tive to the overall variation in the dataset. Two A-D statistics 
(А-О, A-Dyg) are calculated using the identical procedure 
outlined as follows, where A-D,,,,,, А-Омр are the A-D statistic 
calculated using numerical estimates of the sample standard 
deviation(s) as per the rms (root-mean-square) and the МК- 
(moving range of 2) techniques, respectively. The calculation 
steps are as follows: 

A1.4.2.1 Order the non-outlying results such that x, < x; < 


“Ж 
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A1.4.2.2 Obtain standardized variate from the x; values as 
follows: 


w; = (x, = ¥)/s (A1.4) 


for (= 1... п), where s is sample standard deviation of the 
results using either the rms or MR technique, and x is the 
average of the results. 


Note А1.3—Опе standard deviation estimate ~ 0.89 x [average MR] of 
the dataset. 


A1.4.2.3 Convert the w, values to standard normal cumula- 
tive probabilities p; values using the cumulative probability 
table for the standardized normal variate z (see Fig. А1.5): 


р, Probability (z<w,) (А1.5) 
A1.4.2.4 Compute A? as: 
» Qi B 1) [In(p,) + In(1 = Dies) | 
А? — n  (Al.6) 
n 

A1.4.2.5 Compute the quantity A ?* as: 

| 0.75 225) 
А?® = АД 1+——+ == (A1.7) 

n n 


The quantity A?* is referred to as the A-D statistic (A-D). 

A1.4.2.6 Guidance on Interpretation of the Two A-D Statis- 
tics (A-D „ms and A-Dyg): CASE 1—Во А-О, and A-Dyg 
are << 1.0. This is to be interpreted as, “по compelling 
evidence to reject the hypotheses that the data is normal, 
independent, with adequate measurement resolution." Proceed 
to construct control chart with either the rms-based or the 
MR-based standard deviation estimate. 

CASE 2—Both A-D,,,,, and A-Dy are >>> 1.0, and the q-q 
plot shows a few distinct "staircases," which really means the 
majority of the data is clustered into a few unique values. This 
is strong evidence that there is inadequate variation in the 
dataset due to inadequate numerical resolution. Under these 
circumstances, if the total number of unique values in the data 
set is less than six, increase data resolution (carry an additional 
decimal) and reevaluate both A-D statistics for the purpose of 
control charting. Note that because results are used for internal 
QA purposes, this should not be considered as a deviation from 
test method reporting requirements. If additional data resolu- 
tion is not possible, or, if the total number of unique values in 
the data set is six or greater, or, if after increase in data 
resolution, both A-D statistics are still >>1.0, users can still use 
regular plotting of chronological QC data to monitor for 
occurrence of an abnormal event. For the purpose of the latter, 
it is recommended that the run-chart be used with a lower and 
upper percentile-based action limits, provided that there is no 
visual indication of process trending in the data set used to 
determine the action limits. The suggested percentiles are 1st 
and 99th, based on a data set of at least 75 results, collected 
under site precision conditions. It is not the intent of this 
practice to exclude use of other percentiles, or, use of other 
user-defined action limits, provided the limits meet the appli- 
cation requirements. Users are advised to seek qualified statis- 
tical guidance on how to determine the appropriate action 
limits and associated implications. 
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CASE 3—А-О is << 1.0, but A-Dyg > 1.0. This is 
indicative that the test results are serially correlated, or not 
independent. A direct consequence of this non-independence is 
that the standard deviation estimate using the moving range 
technique will underestimate the variation of the total dataset. 
The root cause for this non-independence is typically cyclic 
data caused by diurnal effect of the environment, or moderate 
trending of data due to normal degradation of test equipment. 
If this is judged to be normal behavior of the measurement 
data, proceed to construct control chart with the rms -based 
standard deviation estimate. 


А1.4.3 Example of Normal Probability Plot for QC 
Results—Once 20 results have been obtained (Table A1.3), 
they are sorted in ascending order and paired with the 
corresponding z-values from Fig. A1.4. The paired results (see 
Table A1.6) are plotted as (x, y) points (see Fig. A1.6). A line 
can be added to the plot to facilitate examination of the data for 
deviations from linearity. 

A1.4.3.1 For the above example, the w; and p; values used in 
the calculation of the A-D,ms statistic are shown in Table А1.6, 
as is the individual terms in the summation for A?. The value 
for A? is 0.415, and the value for А?* (A-D,,,,) is 0.44. Similar 
calculation using MR technique yields an A-D,ms value of 0.60. 
Since this is a CASE 1 outcome, the hypothesis of normality, 
data independence, and adequate measurement resolution is 
accepted. 


А1.4.4 Example of Normal Probability Plot for Multiple 
Results from a Single Check Standard—The first 15 prepro- 
cessed results (Table A1.4, Column 4) are sorted in ascending 
order and paired with the corresponding z-values from Fig. 
A1.4. The paired results (Table A1.7) are plotted as x,y points 
(Fig. А1.7). A line can be added to the plot to facilitate 
examination of the data for deviations from linearity. 


А1.4.5 Example of Normal Probability Plot for Results from 
Multiple Check Standards—The first 15 preprocessed results 
(Table A1.5, Column 6) are sorted in ascending order and 
paired with the corresponding z-values from Fig. А1.4. The 
paired results (Table А1.8) are plotted as x, y points (Fig. А 1.8). 
A line can be added to the plot to facilitate examination of the 
data for deviations from linearity. 

A1.4.5.1 For this example, the w,, and p; values used in the 
calculation of the Anderson-Darling statistic are shown in 
Table A1.8, as are the individual terms in the summation for A”. 
The value for А? is 0.673, and the value for А?* is 0.713. Since 
this value is less than 0.752, the hypothesis of normality is 
accepted at the 95 96 confidence level. 


А1.5 The Control Chart 


A1.5.1 1 Chart—The 1 chart is a run chart to which control 
limits and center line have been added. To establish placement 
positions of the control limits for the / chart, an estimate of the 
variability of the measurement system will need to be obtained 
from the data. While there are several statistical techniques that 
can be used for this purpose, this practice advocates use of the 
rms (root-mean-square) technique to estimate sigma, or, 
alternatively, in the absence of auto-correlation, the mr (mov- 
ing range of two) technique for its simplicity and robustness to 
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outliers. Produce an / chart only after а minimum of 20 
preprocessed results have been obtained from the measurement 
system, and the data have been screened (see 8.4.1 and 8.4.2) 
and tested for normality (see А1.4). 

А1.5.1.1 A horizontal center line is added at the level of the 
mean of all the results, Г: 


(A1.8) 


А1.5.1.2 Upper control limits (UCL) and lower control 
limits (LCL) are added, indicating the limits within which 
about 99.7 % of all normally distributed measurement data are 
expected to fall if variability of the measurement system is due 
to random error only. 


For standard deviation estimated from the moving range 
technique, calculate UCL and LCL using Eq А1.9-А1.11: 


n-1 
у) ш rm NES 


L| 
n=l 


M. 


(А1.9) 


UCL = 1+2.66 MR (A1.10) 


LCL = I — 2.66 MR (A1.11) 


Note A1.4—Explanation of the factor 2.66 in Eq A1.10 and Eq А1.11: 
since (MR-bar/1.128) = o, therefore, 3* сь = 3* (MR-bar/1.128) = 
(3/1.128) * MR-bar = 2.66* MR-bar. 


For standard deviation estimated from the root-mean-square 
technique, calculate UCL and LCL using Eq 3 (reproduced 


from 9.1.1) and Ед А1.12 and А1.13: 
UCL = 1+3 хс, (А1.12) 


LCL=] -3 Хор (A1.13) 


A1.5.1.3 Additionally, upper warning limits (UWL) and 
lower warning limits (LWL) are added, and these indicate the 
limits within which about 95 % of all normally distributed data 
are expected to fall. 


UWL = 1+2 Хор (А1.14) 


LWL=] -2 Хор (A1.15) 
Note A1.5—Referring to Note A1.4, the UWL and LWL for sigma 
calculated using (MR-bar/1.128) becomes I-bar = 1.77 MR-bar. 


А1.5.2 ЕММА Оуепау—А EWMA overlay is a trend line 
constructed from EWMA values calculated using the /-values. 
The EWMA trend line is typically overlaid on the / chart to 
enhance its sensitivity in detecting mean shifts that are small 
relative to the measurement system precision. Each EWMA 
value is a weighted average of the current result and previous 
results, with the weights decreasing exponentially with the age 
of the reading. 


А1.5.2.1 A sequence of values, EWMA,, are calculated, and 
overlaid on the / chart and connected. Use the following 
recursion equation: 


EWMA, = I, 
EWMA, = (1 — X)EWMA, , +М, 


(А1.16) 
(А1.17) 
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where A is the exponential weighting factor. For application 
of this practice, a A value between 0.2 to 0.4 is recommended. 


Note Al.6—For the EWMA trend, a X value of 0.4 closely emulates the 
run rule effects of conventional control charts, while a value of 0.2 has 
optimal prediction properties for the next expected value. In addition, 
these 7, values also conveniently places the control limits (3-sigma) for the 
EWMA trend at the 1 (for Х=0.2) to 1.5-sigma (for Х=0.4) values for 7 
chart. 


A1.5.2.2 The control limits for the EWMA chart are calcu- 


lated using a weight (A) as follows: 
UCL, =1+36; 2—% (А1.18) 
À 
LCL, = 1— 30, 2—X (A1.19) 


A1.5.3 MR Chart—A MR of two chart is obtained by 
plotting the sequential range of two values given by: 


MR, = |1, —1,_\| (А1.20) 


and connecting each point. 
А1.5.3.1 The upper control limit for the MR chart is given 
by: 


UCL yj, = 3.27 MR (A1.21) 


A1.5.3.2 There is no lower control limit for an MR chart. 


А154 Declaration of an Out-of-Statistical-Control Sys- 
tem: 

A1.5.4.1 I-chart—Individual values that are outside the 
upper (UCL) or lower (LCL) control limits are strong indica- 
tions of an out-of-statistical-control condition and therefore the 
system shall be declared out-of-statistical-control. In situations 
when the QC sample is immediately retested and there is no 
change to the measurement system between the original test 
and the retest and the retest result is not more than 20g. from 
the center line in either direction, then the system is not 
considered to be out-of-statistical-control. The original and 
retest results shall be documented. In addition, one of the 
following strategies shall be used to detect out-of-statistical- 
control conditions and trigger an out-of-statistical-control dec- 
laration. 


Strategy 1: Run Rule Strategy 
Any one of the following occurrences shall be interpreted as 

a strong signal that a change in state of the measurement 
system has likely occurred and hence the system shall be 
declared out-of-statistical-control: 

(1) Two out of three consecutive results on the I-chart that 
are more than 2сь. from the center line in the same direction. 

(2) Five consecutive results on the I-chart that are more 
than Тор: от the centerline in the same direction. 

(3) Nine or more consecutive results above or below the 
centerline on the I-chart. 

(4) Seven consecutive results steadily increasing or de- 
creasing. 


Note A1.7—Run rules are applicable to control charts generated under 
site precision conditions (see 3.2.20.1). If multiple QC sample results are 
obtained within a 24 h period, then only results separated by at least 4 h 
should be used in site precision calculations and plotted on a control chart 
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in order to reflect the longer term variation in the system. 


Strategy 2: EWMA Strategy 


Use of the EWMA overlay and its associated control limits 
are described in this section. When either the EWMA exceeds 
its control limits, or, run rule (3) in Strategy 1 is violated, it 
shall be interpreted as a strong signal that a change in state of 
the measurement system has occurred and hence the system 
shall be declared out-of-statistical-control. 

A1.5.4.2 MR Chart: 

(1) Any moving range (MR) value that exceeds the upper 
control limit (UCL) should be investigated as a cautionary 
event and any root cause identified documented. 

(2) Five (5) or more out of the past twenty (20) MR values 
that exceed the UCL are strong indications that the system 
variability has increased and hence the system shall be declared 
out-of-statistical-control. 


A1.5.5 Response to Out-of-Statistical-Control Declara- 
tions: 

А1.5.5.1 When a system is declared out-of-statistical- 
control, efforts shall be made to investigate for assignable 
causes, including consideration of QC sample integrity. 

А1.5.5.2 The specific actions to be taken to address an 
out-of-statistical-control declaration is beyond the scope of this 
practice. Each situation should be addressed by users and 
producers of the measurement system results, taking into 
account the application requirement and risk tolerance levels. 
The factors suggested in Note 1 are also applicable to consider 
in formulating action plans to address each type of out-of- 
statistical-control declaration. 

The following interpretations can be used as a guide in 
formulating action plans: 


Out-of-Statistical-Control Event 
1. Single result outside the UCL or 
LCL and is verified by an immediate 
second QC sample result that is also 
outside the UCL or LCL. 


2. Single result outside the UCL or 
LCL and the immediate second QC 
sample result is in the zone between 
the ов: and the UCL or between 
—2og and the LCL. (See Strategy 1 
run rule (1) for comparison) 


3. Out-of-statistical-control declaration 
due to any of the rules in A1.5.4.1 
Strategy 1 or Strategy 2. 


4. Out-of-statistical-control declaration 
due to A1.5.4.2 (2) (5 out of 20 MR 
violations). 


Interpretation 
There are assignable cause(s) 
associated with both QC test results 
as the deviation from the current 
control chart center line (SEV) is of a 
magnitude that is not plausible due to 
common causes. 


There is strong evidence to support 
the notion that there are assignable 
cause(s) associated with both the 
initial out-of-statistical-control and the 
second QC results. 


The process mean has moved away 
from the current control chart center 
line (SEV). 


The variation (precision) as exhibited 
by the results has increased beyond 
the expected variation as determined 
by the data used to set the MR 
control limits. 


A1.5.5.3 If investigation leads to a significant change in the 
measurement system, for example, a recalibration or other 
major service to the measurement system, reset the applicable 
run rule counts, or restart the EWMA prior to running the next 
QC sample. 

A1.5.5.4 Frequent out-of-statistical-control declarations are 
a strong indicator that either the measurement system is not 
properly validated and hence lacks robustness, or the control 
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limits are not determined correctly, or both. In this case, 
validate the measurement system against its requirements and 
confirm that the control limits have been assessed in a correct 
manner. 

A1.5.5.5 Refer to Practice D6792, subsection 10.3 on Qual- 
ity Control Charts, for further guidance. 


А1.5.6 If the control chart data exhibit a strong signal of 
change in the state of the measurement system, investigate for 
root causes. If this investigation leads to a significant change in 
the measurement system, for example, a recalibration or other 
major service to the measurement system, reset the run rule 
counts or restart the EWMA. If frequent violation of run rules 
or EWMA control limits is encountered, this may signal that 
the measurement system is not properly validated and hence 
lacks robustness. In this case, validate the measurement system 
against its requirements. If the investigation into the root 
causes does not lead to a significant change in the measurement 
system, continue with the current control chart but treat results 
as suspect and use them with great caution. 


А1.5.7 Examples of Control Charts for QC and Check 
Standard Results: 

A1.5.7.1 Example of a MR Chart for QC Results—MR; 
values for the data from Table А1.3 are calculated and plotted 
in sequence. After 15 results are obtained, the МК= 0.500 value 
is calculated and added to the plot. Computations are shown in 
Table A1.9. A UCLyjp=1.64 is added to produce the MR chart 
(Fig. A1.9). 


A1.5.7.2 Example of I Chart and EWMA Overlay for QC 
Results—The average of the first 15 QC results (Table А1.9, 
Column 2) is calculated and plotted on the run chart as 7 
=55.73. Тће upper and lower control limits are calculated from 
Eq A1.10 and Eq А1.11 as 54.25 and 57.21 and added to the 
run chart to produce the 7 chart (Fig. A1.10). EWMA values 
(Table A1.9, Column 4) and EWMA control limits, 54.99 and 
56.47, are overlaid on the / chart. Additional results and 
calculated EWMA values are added as they are determined. 

A1.5.7.3 Example of a MR Chart for Multiple Results from 
а Single Check Standard—MR; values are calculated and 
plotted in sequence. After 15 results are obtained (Table A 1.4), 
the MR value is calculated and added to the plot. A ОСЕ р is 
added to produce the MR chart (see Fig. A1.11). 


A1.5.7.4 Example of I Chart and EWMA Overlay for 
Multiple Results from a Single Check Standard—The average 
of the first 20 QC results (see Table A1.4, Column 4) is 
calculated and plotted on the run chart as 7. The upper and 
lower control limits are calculated from Eq A1.9 through Eq 
А1.11 and added to the run chart to produce the / chart. EWMA 
values and EWMA control limits may be overlaid on the / chart 
(Fig. A1.12). Additional results and calculated EWMA values 
are added as they are determined. 

A1.5.7.5 Example of a MR Chart for Results from Multiple 
Check Standards—MR, values are calculated and plotted in 
sequence. After 15 results are obtained (Table A1.5, Column 6, 
displayed again in Table A 1.10), the MR value is calculated and 
added to the plot. А ОСІ р is added to produce the MR chart 
(see Fig. A1.13). 
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А1.5.7.6 Example of I Chart and EWMA Overlay for 
Results from Multiple Check Standards—The average of the 
first 15 QC results (see Table A1.5, Column 6) is calculated and 
plotted on the run chart as 7. The upper and lower control limits 
are calculated from Eq A1.10 and Eq А1.11 and added to the 
run chart to produce the / chart. EWMA values and EWMA 
control limits may be overlaid on the / chart (Fig. А1.14). 
Additional results and calculated EWMA values are added as 
they are determined. 


А1.6 t-Test 


А1.6.1 A two sided r-test is used to check if a sample of 
values comes from a population with a mean different from an 
hypothesized value, цо. In this practice, a t-test may be 
performed on pretreated check standard test results to check for 
bias relative to the ARVs. Since during pretreatment, accepted 
reference value(s) have been subtracted from the raw results, 
the hypothesized mean value is zero. 

А1.6.1.1 For the purpose of performing the t-test, two 
methods for calculating the ¢ value are presented: 

(1) By the root-mean square method, the standard devia- 
tion of the pretreated results is calculated as: 


бе (А1.22) 
(2) The t value 15 calculated as: 
= Vali- и, |15, (A1.23) 


where цо is the hypothesized mean, which is zero (see 
A1.6.1). 

(3) Alternatively, by the MR approach, compute the alter- 
nate ¢ value as: 


tue = Va| I- пој /(МЕ/1.128) (A1.24) 
where цо is the hypothesized mean, which is zero (see 
А1.6.1). 


A1.6.1.2 Compare the computed г value from Eq A1.23 
with the critical 7 values in Table А1.1 for (n—1) degrees of 
freedom. If tyg from Eq A1.24 is used, the appropriate degrees 
of freedom are (n—1)/2. 


A1.6.1.3 If the absolute value of the calculated t (or typ) 
value is less than or equal to the critical 7 value, then Up is 
statistically indistinguishable from the mean of the distribution. 
For the case of check standard testing, this would indicate that 
there is no statistically identifiable bias. 

А1.6.1.4 If the absolute value of t is greater than the critical 
t value, then Up is statistically distinguishable from the mean of 
the distribution, with 95 % confidence. For the case of check 
standard testing, this would indicate a statistically identifiable 
bias in the measurement system. 


A1.6.2 Example ој t-Test Applied to Multiple Results from a 
Single Check Standard—For the first 15 preprocessed results in 
Column 4 of Table A1.4,/ is —0.153. Since the results being 
analyzed are the difference relative to the ARV, ц is zero. The 
standard deviation of the first 15 preprocessed results is 0.493, 
and the 1 value is 1.2034. The г value is less than the critical 
value for 14 degrees of freedom (74 = 2.1448), so the average 
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difference between the check standard results and the accepted 
reference value is statistically indistinguishable from zero. 


A1.6.3 Example of t-Test Applied to Results from Multiple 
Check Standards—For the first 15 preprocessed results in 
Column 6 of Table А1.5,7 is —0.0719. Since the results being 
analyzed are the difference relative to the ARV, Hy is zero. The 
standard deviation of the first 15 preprocessed results is 0.550, 
and the г value is 0.506. The г value is less than the critical 
value for 14 degrees of freedom (1,4 = 2.1448), so the average 
difference between the check standard results and the accepted 
reference value is statistically indistinguishable from zero. 


А1.7 Approximate Chi-Square Test 


А1.7.1 The chi-square (y?) test is used to compare the 
estimated site precision to a published reproducibility value, as 
instructed in 9.1.2. 


А1.7.2 Compute the chi-square statistic. 
For К” estimated using moving range: 


; UR 
X = —38 = (A1.25) 
For К” estimated using root-mean-square: 
(n — 1)8'? 


where R'is the estimated site precision (К'=2.77 x ср.) and 
R is the published reproducibility of the method. 


A1.7.3 Compare the computed у” value to the critical y? 
value in Table A1.11, with (n—1)/2 degrees of freedom for y > 
using moving range-based R’, with (n-1) degrees of freedom 
for X? using root-mean-square based R’. 

A1.7.3.1 If the computed y? value exceeds the tabled value, 
then the site precision exceeds the published reproducibility of 
the method, with 95 % confidence. 

A1.7.3.2 If the computed у” value is less than or equal to the 
tabled value, then the site precision is either less than or 
statistically indistinguishable from the published reproducibil- 
ity of the test method. 


А1.7.4 Example—The site precision calculated from R' = 
2.77 x ов: for the first 20 QC results in Table A1.3 is 1.24. The 
published reproducibility for the measurement method at the 
58.88 level is 1.05. у^ is therefore 19 x 1.24? / 1.05? = 26.50. 
This value is less than the critical value of 30.1 for 19 degrees 
of freedom, so the site precision is not statistically greater than 
the published reproducibility of the test method. 


А1.8 Approximate F-Test 


А1.8.1 In this practice, an approximate F-test is used to 
compare the variation exhibited by a measurement system over 
two different time periods. It can also be used to compare the 
site precision estimated from a series of results from one QC 
sample with that estimated using a different QC sample (see 
8.6.1). 


A1.8.2 Compute the F value. 
For o estimated using moving range: 


F = MR MR? (A1.27) 
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where MR, is the larger of the two average moving ranges, 
and MR, is the smaller. 


For o estimated using root-mean-square: 


о: 
F= 
с 


(А1.28) 


where precision | (с) is larger than (or equal to) precision 2 
(сз). бо F> 1. 


А1.8.3 Compare the computed F value to the critical F 
value read from Table А1.12, with (n,-1) degrees of freedom 
for the numerator and (n,-1) degrees of freedom for the 
denominator if using Eq А1.28, or 0.62(n,-1) degrees of 
freedom for the numerator and 0.62(n,-1) degrees of freedom 
for the denominator if using Eq A1.27. 

А1.8.3.1 If the computed F value exceeds the tabled value, 
then the two precisions are statistically distinguishable. We can 
be 95 % confident that the process that gave rise to precision 1 
(0,) is less precise (has larger site precision) than the process 
that produced precision 2 (оз). 

А1.8.3.2 If the computed F value is smaller than the tabled 
value, then the precisions of the two samplings of the mea- 
surement process are statistically indistinguishable. 


Norte A1.8—Although the approximate F-test is conducted at the 95 96 
probability level, the critical F values against which the calculated F is 
compared come from the 97.5 percentiles of the F-statistic. If the ratio 


МЕ ?/ МЕ? is calculated without requiring that the larger variance is in 
the numerator, the ratio would have to be compared against both the lower 
2.5 percentile point and the upper 97.5 percentile point of the 
F-distribution to determine if the two variances were statistically distin- 
guishable. Because of the nature of the F-distribution, comparing 


MR ?IMR, to the 2.5 percentile point when MR,?/MR,? is equivalent to 
comparing МЕ, МЕ, to the 97.5 percentile point. Requiring that larger 
variance is always in the numerator allows the“ two-tailed” test to be 
accomplished in one step. If the variance of the two populations were 


equal, then there would be only а 2.5 % chance that MR? МЕ? by more 


than the tabulated amount, and a 2.5 % chance that MR МЕ, by more 
than the tabulated amount with degrees of freedom reversed. 


А1.8.4 If two precision estimates are statistically 
indistinguishable, they may be pooled into a single estimate. 
For example, if MR, or precision 1 (сү) was obtained from 
measurements on a single lot of QC sample material, while 
MR, precision 2 (с) was obtained from measurements on a 
different lot of material, and, if they are not statistically 
distinguishable, they may be pooled. The appropriate pooled 
precision estimate is: 


For moving range based precision: 


MR, = Je _ DR) + (л, = 1) (MR) 


(A1.29) 


ti ти са 
For root-mean-square based precision: 
(n, = 1)(o,)? (n, = 1) (o)? 
bad |. шып сос (А1.30) 


А1.8.5 Example—Table А1.13 contains QC results for a 
second QC sample measured by the same measurement system 
used to generate the results in Table А1.3. The standard 
deviation (o) for the 25 results from the original QC sample 
(Table A1.3) 15 0.439. The standard deviation (о) for the 23 
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results for the new QC sample is 0.883. The F value is 4.05, 
which is larger than the critical value of 2.36 for 22 and 24 
degrees of freedom in the numerator and denominator, respec- 
tively. Based on standard deviation, the precision of the 
measurements for the two QC batches would be statistically 
different, and hence the standard deviations should not be 
pooled. 


Моте A1.9—For the example in А1.8.5 using Table A1.13 data, the 
conclusion using root-mean-square based standard deviation is the correct 
conclusion, and this is different than the conclusion reached using the 
moving ranges based standard deviation. Visual examination with confir- 
mation from the Q-procedure showed a downward trend that induced 
autocorrelation in the data. The moving ranges based technique did not 
capture the overall variation in the dataset, and therefore, it did not provide 
the correct conclusion. 


A1.9 Procedure 2-A: Q-Procedure 


А1.9.1 Collect and prepare a new batch of QC material. 
Whilst this can be performed at any time, it should be 
completed when the current QC material supply remaining can 
support no more than two analyses. 


А1.9.1.1 Validate the first result obtained on the new QC 
material either by a concurrent test of the soon-to-be-depleted 
QC material, or by concurrently testing a check standard. If no 
special-cause signals are noted, then the result for the new 
material is considered to be valid. 


A1.9.1.2 Beginning with the second result, calculate the Q 
statistic as follows: 


Q,- (= =) (x, = m НИЦИ 


Nie 


А1.31 
9, ( ) 
where: 
О, = the Q statistic calculated using the current (rth) test 
result X, 
r = the result number in chronological sequence as it 
_ arrives, 
X., = is the average calculated using all past results up to 
r-1, and 
бо = the site historical standard deviation for the test 


method as per 8.7.3.1. 


А1.9.1.3 Plot and interpret the Q-statistic using the I/MR/ 
EWMA methods without data pre-treatment as described in 
А1.5, with the exception that the following fixed values are to 
be used as the center and control limits: 

(1) For the I-chart with EWMA: 


center line = 0.0; UCL = 3.0; LCL = —3.0; UCLewma = 1.5; LCLewma = 71.5 


(2) For the MR-chart: 
center line = 1.128; UCL = 3.86 


A1.10 Procedure 2-B: Dynamically Updated I Chart 


A1.10.1 Collect and prepare a new batch of QC material. 
Whilst this can be performed at any time, it should be 
completed when the current QC material supply remaining can 
support no more than two analyses. 


А1.10.2 Validate the first result obtained on the new ОС 
material either by a concurrent test of the soon-to-be-depleted 
QC material, or by concurrently testing a check standard. If no 
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special-cause signals are noted, then the result for the new 
material is considered to be valid. 


A1.10.3 Plot the first result from the new material as the first 
point on the dynamically updated I / EWMA chart. 


Norte A1.10—One way to better understand the difference between the 
dynamically updated I / EWMA and the traditional I / EWMA techniques 
is as follows: The traditional I / ЕМА uses a “forward looking" strategy 
where the in-statistical-control decision limits are fixed, and all future data 
is judged against these fixed limits. For the dynamically updated I / 
EWMA techniques, each new result is first judged against limits computed 
using all previous results. If it is in control, the control chart center line 
and limits are re-computed by adding this latest in-control result into the 
dataset. This re-computed set of limits are then applied to the current and 
all past data to confirm the process is in control (because if it is, then 
current and all past data should be inside the decision limits). 

А1.10.4 Center this value on the y-axis of the new chart. 
Scale the y-axis to allow room for the initial result plus and 
minus five historical standard deviations, where the standard 


deviations are appropriate to the level of the first result. 


А1.10.5 Setn = 1. No center line, nor upper or lower control 
limits, are plotted at this time. 


А1.10.6 Increment n by 1 to n = 2 with the arrival of the 
second new result. Compute and plot the center value, the 
upper and lower limits using equations Eq A1.32, Eq А1.33, 
and Eq A1.34 to be used to judge the 2nd result. If both (1st and 
2nd) results are within the computed limits, declare the system 
is in control. Increment п by 1 to п = 3. Re-compute and re-plot 
the center line and control limits using Eq A1.32, Eq A1.33, 
and Eq А 1.34. Set the re-computed control limits as the current 
active control limits. Herein after, as each new result arrives, 
plot and compare the new result to the current active control 
limits. If the new result is within the limits, increment n by 1; 
re-compute and re-plot the center line and control limits using 
Eq A1.32, Eq A1.33, and Eq A1.34. Declare the system is in 
control if all results are within the re-computed limits. Set the 
re-computed control limits as the current active control limits 
to be used to judge the next new result. All previous center and 
control limits can be optionally plotted and connected with 
broken lines to show the trajectory of the statistics with past 
data. 

A1.10.6.1 Center Value: 


п=1 


оа 2, L/(n — 1) 


A1.10.6.2 Upper Control Limit: 


(A1.32) 


UCL, = C, 3 оү. : (A1.33) 


= 1) 
where o is the historical standard deviation appropriate for 
test level С,. 


A1.10.6.3 Lower Control Limit: 


n 
LCL, = С, TON a= 1) 


A1.10.7 Individual values, current or earlier, which are 
outside the current upper or lower control limits, are indica- 
tions of an unstable system, and efforts should be made to 
determine the cause. In a similar fashion to the J chart (as 
described in A1.5.1), one of the following strategies shall be 


(A1.34) 


used to detect changes in state of the measurement system that 
are considered to constitute an out-of-control situation. 


Strategy 1: Run Rule Strategy 
Any one of the following occurrences shall be interpreted as 
a strong signal that a change in state of the measurement 
system has likely occurred: 
A1.10.7.1 Two consecutive results оп the Q-chart that are 


n . 
more than 2 6 y/ [cy distant from the current expected value, 
С, in the same direction; 


п? 


A1.10.7.2 Five consecutive results on the Q-chart that are 


n : А 
more than с 4 / (а= distant from the current expected value in 
the same direction. 


A1.10.7.3 Nine or more consecutive results on the Q-chart 
that are on the same side of the current expected value. 

A1.10.7.4 Seven points in a row steadily increasing or 
decreasing. 


A1.10.8 Continue or replace the MR chart, as appropriate. 

А1.10.8.1 If the standard deviation for the new QC material 
1s the same as for the old material, continue the old MR chart 
beginning with MR,, that is, the second result from the new 
material. 

А1.10.8.2 If the standard deviation appropriate to the level 
of the new material is different from the old, begin a new MR 
chart, starting with MR,. The upper control limit for the new 
chart should be placed at 3.696. 

A1.10.8.3 After 15 results have been obtained with the new 
material, use а chi-square (see А1.7) or F-test (see А1.8) to 
check that o is appropriate for the new material. 


Strategy 2: EWMA (Exponentially Weighted Moving 
Average) Strategy 


A1.10.9 EWMA Overlay on Procedure 2-B: Dynamically 
Update I Chart —An EWMA chart may be overlaid on the 
dynamically updated I-chart, although it will not be meaningful 
until n » 5. 

A1.10.9.1 The sequence of EWMA values, EWMA,, are 
calculated, and overlaid on the / chart and connected. Use the 
following recursion: 


EWMA, = 1, 
EWMA, = (1 — X)5EWMA, , +A, 


(A1.35) 
(A1.36) 


where A is the exponential weighting factor, typically set to 
0.4. 
A1.10.9.2 The upper control limit for the EWMA chart is 


1 san [1—25 
UCLewna = Се ава | zoz D + 2(1 — xcti e 


(А1.37) 


A1.10.9.3 The lower control limit for the EWMA chart 15 


1 an [172A 
LOL. Ст 304| sae + 20 М ре 
(А1.38) 
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A1.10.9.4 The upper and lower EWMA (UCLgwma and 
КСГ ум ) control limits associated with C, are plotted іп a 
similar fashion as the UCL, and LCL, described in A1.10.6.2 
and А1.10.6.3. Individual EMWA values, current or earlier, 
which are outside the current EWMA upper or lower control 
limits, are indications of an unstable system, and efforts should 
be made to determine the cause. 


A1.10.10 Procedure 2-A, B Examples—Tables A1.13 and 
А1.14 and Figs. A1.15 and A1.16 provide illustrative examples 
of procedures 2-A and 2-B. 


TABLE A1.1 95th Percentile of Student's t Distribution (1 through 


100) 
Degrees of Freedom t 
1 12.7062 
2 4.3027 
3 3.1824 
4 2.7764 
5 2.5706 
6 2.4469 
7 2.3646 
8 2.3060 
9 2.2622 
10 2.2281 
11 2.2010 
12 2.1788 
13 2.1604 
14 2.1448 
15 2.1814 
16 2.1199 
17 2.1098 
18 2.1009 
19 2.0930 
20 2.0860 
21 2.0796 
22 2.0739 
23 2.0687 
24 2.0639 
25 2.0595 
26 2.0555 
27 2.0518 
28 2.0484 
29 2.0452 
30 2.0423 
31 2.0395 
32 2.0369 
33 2.0345 
34 2.0322 
35 2.0301 
36 2.0281 
37 2.0262 
38 2.0244 
39 2.0227 
40 2.0211 
41 2.0195 
42 2.0181 
43 2.0167 
44 2.0154 
45 2.0141 
46 2.0129 
47 2.0117 
48 2.0106 
49 2.0096 
50 2.0086 
55 2.0040 
60 2.0003 
65 1.9971 
70 1.9944 
75 1.9921 
80 1.99006 
85 1.98827 
90 1.98667 
95 1.98525 
100 1.98397 
17 


D6299 - 20 


TABLE А1.2 95th Percentile of Student's 7 Distribution (105 


through 200) 


Degrees of Freedom 


t 


105 
110 
115 
120 
125 
130 
135 
140 
145 
150 
155 
160 
165 
170 
175 
180 
185 
190 
195 
200 


1.98282 
1.98177 
1.98081 
1.97993 
1.97912 
1.97838 
1.97769 
1.97705 
1.97646 
1.97591 
1.97539 
1.97490 
1.97445 
1.97402 
1.97361 
1.97323 
1.97287 
1.97253 
1.97220 
1.97190 


TABLE A1.3 Example of a Sequence of Results from a Single QC 


Sequence Number 


Sample 


QC/Check Standard 


Sequence Number 


QC/Check Standard 


Result Result 
' Ү, = |, i Ү, = |, 
1 55.3 14 55.2 
2 55.8 15 56.5 
3 56.3 16 55.7 
4 56.1 17 55.6 
5 55.8 18 55.2 
6 55.5 19 55.7 
7 55.3 20 56.1 
8 55.4 21 56.3 
9 56.6 22 55.2 
10 56.1 23 55.4 
11 55.0 24 55.4 
12 55.5 25 55.6 
13 55.5 
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TABLE A1.4 Example of a Sequence of Results from a Single 
Check Standard 


Sequence Number Check Standard Accepted Difference 
Result Reference Value Result - ARV 
(Y) (ARV = X) ] 
1 55.3 55.88 20.58 
2 55.8 55.88 -0.08 
3 56.3 55.88 0.42 
4 56.1 55.88 0.22 
5 55.8 55.88 -0.08 
6 55.5 55.88 -0.38 
7 55.3 55.88 -0.58 
8 554 55.88 -0.48 
9 56.6 55.88 0.72 
10 56.1 55.88 0.22 
1i 55.0 55.88 -0.88 
12 55.5 55.88 -0.38 
13 55.5 55.88 -0.38 
14 55.2 55.88 -0.68 
15 56.5 55.88 0.62 
16 55.7 55.88 -0.18 
17 55.6 55.88 -0.28 
18 55.2 55.88 -0.68 
19 55.7 55.88 -0.18 
20 56.1 55.88 0.22 
21 56.3 55.88 0.42 
22 55.2 55.88 -0.68 
23 55.4 55.88 -0.48 
24 55.4 55.88 -0.48 
25 55.6 55.88 -0.28 


TABLE А1.5 Example of Results for Multiple Check Standards 
Where the Precision of the Measurement System Is Level 


Dependent 
Result Ваш ARV Raw Preprocessed 
Sequence : oj Result 
. Result Y; X; Difference ' 

Митрег, / l; 
1 71.0 71.4 -0.40 1.14 -0.35 
2 65.8 64.9 0.90 1.10 0.82 
3 70.3 70.2 0.10 1.18 0.09 
4 66.2 67.7 -1.50 1.11 -1.35 
5 93.8 93.4 0.40 1.26 0.32 
6 102.9 104.0 -1.10 1.33 -0.83 
7 102.2 101.8 0.40 1.31 0.30 
8 103.2 103.9 -0.70 1.32 -0.53 
9 100 99.8 0.20 1.30 0.15 
10 716 71.5 0.10 1.14 0.09 
11 76.7 76.4 0.30 1.16 0.26 
12 61.2 61.8 -0.60 1.08 -0.56 
13 44.1 43.9 0.20 0.98 0.20 
14 69.71 69.7 0.01 1.13 0.01 
15 59.5 59.19 0.31 1.06 0.29 
16 99.63 98.87 0.76 1.30 0.59 
17 93.7 95.21 -1.51 1.27 -1.19 
18 103.77 103.94 -0.17 1.32 -0.13 
19 96.18 96.7 -0.52 1.28 -0.41 
20 99.7 100.65 -0.95 1.31 -0.73 
21 84.32 84.15 0.17 1.21 0.14 
22 83.29 83.75 -0.46 1.21 -0.38 
23 65.16 65.93 -0.77 1.10 -0.70 
24 68.19 68.0 0.19 1.12 0.17 
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TABLE A1.6 Example Data for a Normal Probability Plot for QC 


Results 
Original A 
Sequence z-value Sorted Result и, Di P ul ЕҢ 
1.6 
No., / 
11 -1.83 55.0 -1.47 0.07 -5.91 
14 -1.28 55.2 -1.07 0.14 -14.35 
1 -0.97 55.3 -0.86 0.19 -18.70 
7 -0.73 55.3 -0.86 0.19 -21.94 
8 -0.52 55.4 -0.66 0.25 -25.77 
6 -0.34 55.5 -0.46 0.32 -21.44 
12 -0.17 55.5 -0.46 0.32 -25.34 
13 0.00 55.5 -0.46 0.32 -22.80 
2 0.17 55.8 0.15 0.56 -16.52 
5 0.34 55.8 0.15 0.56 -18.46 
10 0.52 56.1 0.76 0.78 -11.50 
4 0.73 56.1 0.76 0.78 -10.80 
3 0.97 56.3 1.16 0.88 -8.65 
15 1.28 56.5 1.57 0.94 -5.79 
9 1.83 56.6 1.77 0.96 -3.25 


TABLE А1.7 Example Data for a Normal Probability Plot for 
Multiple Results from a Single Check Standard 


Sort No oe Sorted z-value W, р, тетип 
` Мо. Result | d Eq A1.6 
1 11 -0.88 -1.83 -1.47 0.07 -5.91 
2 14 -0.68 -1.28 -1.07 0.14 -14.35 
3 1 -0.58 -0.97 -0.86 0.19 -18.70 
4 T -0.58 -0.73 -0.86 0.19 -21.94 
5 8 -0.48 -0.52 -0.66 0.25 -25.77 
6 6 -0.38 -0.34 -0.46 0.32 -21.44 
7 12 -0.38 -0.17 -0.46 0.32 -25.34 
8 13 -0.38 0 -0.46 0.32 -22.80 
9 2 -0.08 0.17 0.15 0.56 -16.52 
10 5 -0.08 0.34 0.15 0.56 -18.46 
11 10 0.22 0.52 0.76 0.78 -11.50 
12 4 0.22 0.73 0.76 0.78 -10.80 
13 3 0.42 0.97 1.16 0.88 -8.65 
14 15 0.62 1.28 1.57 0.94 -5.79 
15 9 0.72 1.83 1.77 0.96 -3.25 


TABLE А1.8 Example Data for a Normal Probability Plot for 
Results from Multiple Check Standards 


Original ^ s reg f^ Term in 
Sort No. еше Result z-value и; Л Eq A1.6 
1 4 -1.35 -1.83 -2.320 0.010 -7.535 
2 6 -0.83 -1.28 71.375 0.084 =11.721 
3 12 -0.56 -0.97 -0.885 0.188 -15.301 
4 8 -0.53 -0.73 -0.831 0.203 -20.722 
5 1 -0.35 -0.52 -0.504 0.307 -22.310 
6 14 0.01 -0.34 0.150 0.560 -19.259 
7 3 0.09 -0.17 0.295 0.616 -20.207 
8 10 0.09 0 0.295 0.616 -21.627 
9 9 0.15 0.17 0.404 0.657 -23.418 
10 13 0.2 0.34 0.495 0.690 -22.641 
11 11 0.26 0.52 0.604 0.727 -14.400 
12 15 0.29 0.73 0.659 0.745 -11.994 
13 7 0.3 0.97 0.677 0.751 -12.376 
14 5 0.32 1.28 0.713 0.762 -9.718 
15 2 0.82 1.83 1.621 0.948 -1.860 
A?* = 0.713 
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TABLE A1.9 Example Data for / Chart and EWMA Overlay for QC 


Results 

кы Number, ос Result (Y=/) Moving Range МА, EWMA; 
1 55.3 55.3 
2 55.8 0.5 55.50 
3 56.3 0.5 55.82 
4 56.1 0.2 55.93 
5 55.8 0.3 55.88 
6 55.5 0.3 55.73 
7 55.3 0.2 55.56 
8 55.4 0.1 55.49 
9 56.6 1.2 55.94 
10 56.1 0.5 56.00 
11 55 14 55.60 
12 55.5 0.5 55.56 
13 55.5 0.0 55.54 
14 55.2 0.3 55.40 
15 56.5 1.8 55.84 

Average (1 to 15) 55.73 0.500 
16 55.7 0.8 55.78 
17 55.6 0.1 55.71 
18 55.2 0.4 55.51 
19 55.7 0.5 55.58 
20 56.1 0.4 55.79 
21 56.3 0.2 55.99 
22 55.2 14 55.68 
23 55.4 0.2 55.57 
24 55.4 0.0 55.50 
25 55.6 0.2 55.54 


TABLE A1.10 Example Data for a MR Chart for Results from 
Multiple Check Standards 


Result Sequence Preprocessed 


Number, i Result, /; Moving Range, МВ, EWMA; 
| mE -0.35 
2 0.82 1.17 0.12 
3 0.09 0.73 0.11 
4 -1.35 1.44 -0.48 
5 0.32 1.67 -0.16 
6 -0.83 1.15 -043 
7 0.30 1.13 -0.14 
8 -0.53 0.83 -0.29 
9 0.15 0.68 -0.12 
10 0.09 0.06 -0.03 
11 0.26 0.17 0.08 
12 -0.56 0.82 -0.17 
19 0.20 0.76 -0.02 
14 0.01 0.19 -0.01 
15 0.29 0.28 0.11 

Average -0.073 0.791 
16 0.59 0.3 0.30 
17 -1.19 1.78 -0.29 
bs -0.13 1.06 -0.23 
19 -0.41 0.28 -0.30 
20 -0.73 0.32 -0.47 
21 0.14 0.87 -0.23 
22 -0.38 0.52 -0.29 
23 -0.7 0.32 -0.45 
24 0.17 0.87 -0.20 
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TABLE А1.11 95th Percentiles of the Chi Square Distribution 


Degrees 

Freedom $ 
7 14.1 
8 15.5 
9 16.9 
10 18.3 
11 19.7 
12 21:0 
13 22.4 
14 28.7 
15 25.0 
16 26.3 
17 27.6 
18 28.9 
19 30.1 
20 31.4 
21 32.7 
22 33.9 
23 35.2 
24 36.4 
25 37.7 
26 38.9 
27 40.1 
28 41.3 
30 43.8 
35 49.8 
40 55.8 
45 61.7 
50 67.5 
60 79.1 
70 90.5 
80 101.9 


TABLE A1.12 97.5 Percentiles of the F-Statistic 


Denominator, Numerator 
degrees of 

treodom 7 8 9 10 12. 14 16 18 20 25 30 40 50 100 
7 4.99 4.90 4.82 476 4.67 4.60 4.54 4.50 447 4.40 4.36 4.31 4.28 4.21 

8 4.53 4.43 4.36 4.30 4.20 4.18 4.08 4.03 4.00 3.94 3.89 3.84 3.81 3.74 

9 4.20 4.10 4.03 3.96 3.87 3.80 3.74 3.70 3.67 3.60 3.56 3.51 3.47 3.40 

10 3.95 3.85 3.78 3.72 3.62 3,55 3.50 3.45 3.42 3.35 3.31 3.26 3.22 3.15 

11 3.76 3.66 3.59 3.53 3.43 3.96 3.30 3.26 3.23 3.16 3.12 3.06 3.03 2.96 

12 3.61 3.51 3.44 3.37 3.28 3.21 3.15 3.11 3.07 3.01 2.96 2.91 2.87 2.80 
13 3.48 3.39 3.31 3.25 3.15 3.08 3.03 2.98 2.95 2.88 2.84 2.78 2.74 2.67 
14 3.38 3.29 3.21 3.15 3.05 2.98 2.92 2.88 2.84 2.78 2.73 2.67 2.64 2.56 
15 3.29 3.20 3.12 3.06 2.96 2.89 2.84 2.79 2.76 2.69 2.64 2.59 2.55 2.47 
16 3.22 3.12 3.05 2.99 2.89 2.82 2.76 2.72 2.68 2.61 2.57 2.51 2.47 2.40 
17 3.16 3.06 2.98 2.92 2.82 2.75 2.70 2.65 2.62 2.55 2.50 2.44 2.41 2.38 
18 3.10 3.01 2.93 2.87 2.77 2.70 2.64 2.60 2.56 2.49 2.44 2.38 2.35 2.27 
19 3.05 2.96 2.88 2.82 2.72 2.65 2.59 2.55 2.51 2.44 2.39 2.38 2.30 2.22 
20 3.01 2.91 2.84 2.77 2.68 2.60 2.55 2.50 2.46 2.40 2.35 2.29 2.25 2.17 
25 2.85 2.75 2.68 2.61 2.51 2.44 2.38 2.34 2.30 2.28 2.18 2.12 2.08 2.00 
30 2.75 2.65 2.57 2.51 2.41 2.34 2.28 2.23 2.20 2.12 2.07 2.01 1.97 1.88 
35 2.68 2.58 2.50 2.44 2.34 2.27 2.21 2.16 2.12 2.05 2.00 1.93 1.89 1.80 
40 2.62 2.53 2.45 2.39 2.29 2.21 2.15 2.11 2.07 1.99 1.94 1.88 1.83 1.74 
45 2.58 2.49 2.41 2.35 2.25 217 2.11 2.07 2.03 1.95 1.90 1.83 1.79 1.69 
50 2.55 2.46 2.38 2.32 2.22 2.14 2.08 2.03 1.99 1.92 1.87 1.80 1.75 1.66 
60 2.51 2.41 2.33 2.27 2.17 2.09 2.03 1.98 1.94 1.87 1.82 1.74 1.70 1.60 
70 2.47 2.38 2.30 2.24 2.14 2.06 2.00 1.95 1.91 1.83 1.78 1.71 1.66 1.56 
80 2.45 2.35 2.28 2.21 2.11 2.03 1.97 1.92 1.88 1.81 1.75 1.68 1.63 1.53 
90 2.43 2.34 2.26 2.19 2.09 2.02 1.95 1.91 1.86 1.79 1.73 1.66 1.61 1.50 
100 2.42 2.32 2.24 2.18 2.08 2.00 1.94 1.89 1.85 TO 1.71 1.64 1.59 1.48 
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TABLE A1.13 Example Data for Procedure 2-A — О Procedure 
бо = 0.51; 2 0.4 


Obs. No Test Result о Q ewma à UCL LCL UCL LCL 
(г) (Х) < О О Q ewma Q ewma 
1 7.8 = 0.00 —3.00 3.00 
2 7.1 —0.97 –0.39 0.00 —3.00 3.00 
3 8.0 0.88 0.12 0.00 —3.00 3.00 
4 7.7 0.11 0.12 0.00 —3.00 3.00 
5 8.0 0.61 0.32 0.00 —3.00 3.00 
6 7.9 0.32 0.32 0.00 —3.00 3.00 —1.50 1.50 
7 7.6 —0.27 0.08 0.00 —3.00 3.00 —1.50 1.50 
8 7.8 0.13 0.10 0.00 —3.00 3.00 —1.50 1.50 
9 8.1 0.67 0.33 0.00 —3.00 3.00 —1.50 1.50 
10 6.4 –2.56 –0.83 0.00 —3.00 3.00 —1.50 1.50 
11 7.1 —1.01 —0.90 0.00 —3.00 3.00 —1.50 1.50 
12 7.8 0.39 —0.38 0.00 —3.00 3.00 —1.50 1.50 
13 6.8 —1.52 —0.84 0.00 —3.00 3.00 —1.50 1.50 
14 7.4 —0.28 —0.61 0.00 —3.00 3.00 —1.50 1.50 
15 8.2 1.26 0.13 0.00 —3.00 3.00 —1.50 1.50 
16 7.8 0.42 0.25 0.00 —3.00 3.00 —1.50 1.50 
17 7.0 —1.18 —0.30 0.00 —3.00 3.00 —1.50 1.50 
18 6.4 -2.21 —1.07 0.00 —3.00 3.00 —1.50 1.50 
19 8.2 1.85 —0.10 0.00 —3.00 3.00 —1.50 1.50 
20 7.9 0.70 0.22 0.00 —3.00 3.00 —1.50 1.50 

TABLE A1.14 Example Data for Procedure 2-B – Dynamically Updated | Chart 
бо 2 0.51; 2 0.4 
Obs. No. Test Result Бата С - x rn UCL LCL UCL LCL 
(1) (X v) = n Xr Xr EWMA r EWMA_r 
1 7.8 7.8 — 
2 7.1 7.52 7.80 9.97 5.63 9.03 6.57 
3 8.0 7.71 7.45 9.33 5.57 8.38 6.52 
4 7.7 7.71 7.63 9.40 5.86 8.46 6.81 
5 8.0 7.82 7.65 9.36 5.94 8.44 6.86 
6 7.9 7.85 4.72 9.40 6.04 8.50 6.94 
7 7.6 7.75 7.75 9.41 6.09 8.52 6.98 
8 7.8 7.77 7.73 9.37 6.09 8.50 6.96 
9 8.1 7.90 7.74 9.36 6.11 8.51 6.97 
10 6.4 7.30 7.78 9.39 6.16 8.55 7.01 
11 71 7.22 7.64 9.25 6.03 8.41 6.87 
12 7.8 7.45 7:59 9.19 5.99 8.36 6.82 
13 6.8 7.19 7.61 9.20 6.01 8.38 6.84 
14 7.4 7.27 7.55 9.14 5.96 8.32 6.78 
15 8.2 7.64 7.54 9.12 5.95 8.31 6.77 
16 7.8 7.71 7.58 9.16 6.00 8.35 6.81 
17 7.0 7.42 7.59 9.17 6.01 8.36 6.82 
18 6.4 7.01 7.56 9.14 5.98 8.33 6.79 
19 8.2 7.49 7.49 9.07 5.92 8.26 6.72 
20 7.9 7.65 7.53 9.10 5.96 8.30 6.76 
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FIG. A1.2 Run Chart for Multiple Results from a Single Check 
Standard 
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FIG. A1.3 Run Chart for Results from Multiple Check Standards 
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Note 1— Probability (z < w,), where w; is the sum of the number in the left column and top row. 
FIG. A1.5 p, Values 
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FIG. A1.7 Example of a Normal Probability Plot for Multiple Re- 
sults from a Single Check Standard 


FIG. A1.8 Example of a Normal Probability Plot for Results from 
Multiple Check Standards 
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FIG. A1.10 Example of an /-Chart with EWMA Overlay for QC Re- 
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FIG. A1.11 Example of a MR Chart for Multiple Results from a 
Single Check Standard 
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FIG. A1.12 Example of an /-Chart with EWMA Overlay for Multiple 
Results from a Single Check Standard 
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FIG. A1.13 Example of a MR Chart for Results from Multiple 
Check Standards 


o Result Value • EWMA Value 


Preprocessed Result 


0 5 10 15 20 25 30 
Result Sequence Number 


FIG. A1.14 Example of an /-Chart with EWMA Overlay for Results 
from Multiple Check Standards 
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APPENDIX 


(Nonmandatory Information) 


X1. DERIVATION FOR CONTROL LIMITS FOR PROCEDURE 2-B: DYNAMICALLY UPDATED I / EWMA CONTROL 
CHART 


X1.1 Let (X; i = 1,2,...} are independent normal random 
variables with the same, known standard deviation, o. If there 
are no special causes, then they share a common, but unknown 
mean џ. 


X1.2 I-Chart (for Individual Observations) 


X1.2.1 At the time of the п observation, the monitored 
variable is X,,. Its standard deviation is ø. If и were known, then 
the control limits would be u = Зо. But, as u is unknown, we 
have to compare a newly arrived X, to control limits con- 
structed using an estimate of u, which, is X, ;, the mean of the 
first n — 1 observations. 

X1.2.2 As X, is independent of X, ,, the variance of 

2 


o 1 ; с 
X, — X, 1s the sum of the variances, namely а i so the 


n 


limits are X, ,=36 { 
n-i 


X1.3 EWMA Chart 


X1.3.2 The variance of 
Y,2o|(1—2ajpe"-»-3? YX(1- y. the second term of 
i=0 


which is proportional to a partial geometric series, easily 
summed and not-so-easily simplified to 


zD H 


X1.3.3 This variance very quickly approaches its asymp- 


2 


Gc аав 
totic value of 5—7 


control limits for Y,, would be 


var(Y,) = sl Aye]. (X1.2) 


as n increases, and, if u is known, the 


1 : : : 
5А + 2 (1 — А)" 1]. Again, when и is unknown, it 
must be estimated using X, у. For the EWMA, both the 
variance of the estimate X, , and the correlation between X, , 


and with Y, has to be taken into consideration. 


ut3o 


X1.3.4 The variance of У, — X, , comes out to be 


Х1.3.1 Now the monitored variable is not X, but the up eli с m Therefore, control limits for the latest 
exponentially-weighted moving average Y,,, where У, = X, and, EWMA Y (n : ) 
for all n > 1, Y, = AX, + (1 – 2)Y, ;,,andO с 4 < 1 is a constant кане 
to be chosen by the user. Y, may also be written as: Е 1 1—2 
Ж & ne [a] +20 = 0) | я] | 
Y,=(1 — APX +t DAC — APX, XI.1 
ge yx XM "х, (X11) (X1.3) 
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SUMMARY OF CHANGES 


Subcommittee D02.94 has identified the location of selected changes to this standard since the last issue 
(D6299 — 19) that may impact the use of this standard. (Approved May 1, 2020.) 


(1) Revised discussions of analytical measurement system in (3) Revised subsection A1.10.10 and added new examples in 


3.2.4. Tables A1.13 and А1.14 and Figs. А1.15 and А1.16. 
(2) Revised definition of site precision standard deviation in 
3.2.21. 
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(D6299 - 18) that may impact the use of this standard. (Approved Nov. 1, 2019.) 


(1) Revised subsections 8.7.3, 8.7.3.1, 8.7.3.4, and 8.9. (4) Revised A1.10 and related subsections. 


(2) Added subsection 8.7.4. (5) Added Appendix XI. 
(3) Revised A1.9 and related subsections. 
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